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(54) INFORMATION PROCESSING DEVICE AND METHOD, PROGRAM STORAGE MEDIUM, 
RECORDING MEDIUM, AND PROGRAM 



(57) The present invention facilitates reading in ad- 
vance information on addresses where data of each re- 
production path to be reproduced is stored. Clip AV 
stream 1 to Clip AV stream 3 of angles forming a multi- 
angle are managed by PlayList#1 to PlayList#3 for the 
different angles. Each of PlayList#1 to Playl_ist#3 is di- 



vided by angle change points. Each of the divided re- 
producing sections corresponds to a Playltem. Corre- 
spondences between source packet numbers and pres- 
entation time stamps of the angle change points are re- 
corded in an EP_map. The present invention is applica- 
ble to DVD recording and reproducing apparatus, for ex- 
ample. 
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Description 

Technical Field 

[0001] The present invention relates to an apparatus 
and a method for information processing, a program 
storing medium, a recording medium, and a program, 
and particularly to an apparatus and a method for infor- 
mation processing, a program storing medium, a record- 
ing medium, and a program that make it possible to 
quickly reproduce address information of a reproduction 
path recorded on a recording medium. 

Background Art 

[0002] The following method has been previously 
known as a method for quickly performing determination 
of a reading position in an AV stream and decoding 
processing and quickly retrieving a specified mark in re- 
producing a recording medium on which a plurality of 
pieces of data including video data, audio data, and the 
like are recorded (see Japanese Patent Laid-Open No. 
2002-158971, for example). 

[0003] According to the method, a stream of an entity 
of contents is managed by Clip Information and repro- 
duction of the AV stream is managed by a PlayList. As 
attribute information of the AV stream, address informa- 
tion RSPN_arrival_time_discontinuity on discontinuity 
points in the AV stream, information EP_map or 
TU_map for associating time information with address 
information in the AV stream, and time information Clip- 
Mark on a characteristic image in the AV stream are re- 
corded in the Clip Information. 

[0004] There is DVD (Digital Versatile Disc) video, in 
particular, as the above-mentioned recording medium 
on which a plurality of pieces of data including video da- 
ta, audio data, and the like are recorded. A format of the 
DVD video defines multiangle reproduction. In a prede- 
termined reproducing section allowing multiangle repro- 
duction, a user can select an angle that suits preference 
of the user. At this time, change between angles can be 
performed seamlessly by a recording and reproducing 
apparatus. 

[0005] FIG. 1 is a diagram of assistance in explaining 
a multiangle format of a DVD video. 
[0006] A multiangle reproducing section includes a 
plurality of reproducing sections. One of the reproducing 
sections is referred to as a Cell. In the example of FIG. 
1, the multiangle reproducing section includes Cell#i + 
1 to Cell#i + 3 of three angles, that is, an angle 1 (An- 
gle#1) to an angle 3 (Angle#3). AV stream data of an 
entity corresponding to Cells is referred to as a VOB 
(Video Object). A VOB corresponding to each Cell for 
forming a multiangle is divided into units referred to as 
ILVUs (Interleaved Units) not shown in the figure. The 
plurality of VOBs including the multiangle are multi- 
plexed in ILVU units. Incidentally, each ILVU starts with 
a Closed GOP (Group of Pictures). 



[0007] Description will be made of seamless angle 
change reproduction in a multiangle of a DVD video. 
When a user changes a reproduction path from the an- 
gle 2 to the angle 1 and then to the angle 3, for example, 

5 the recording and reproducing apparatus sequentially 
reads and reproduces data of an ILVU 1 , an ILVU 2, and 
an ILVU 3 (none of them are shown) while jumping on 
the disk. Incidentally, each ILVU starts with DSI (Data 
Search Information), and the DSI has an address of a 

10 next ILVU of each angle to which to jump. 

[0008] However, since DSI is embedded in an AV 
stream referred to as VOB, it is difficult to obtain infor- 
mation on an address where each piece of angle data 
to be reproduced next is stored, unless the AV stream 

15 is read. Hence, it takes time to read in advance all infor- 
mation on addresses where pieces of angle data to be 
reproduced in the future are stored, because all AV 
streams need to be read. 



[0009] The present invention has been made of such 
a situation, and it is an object of the present invention 
to enable information on addresses where pieces of an- 
gle data are stored to be obtained quickly. 
[0010] According to the present invention, there is 
provided a first information processing apparatus char- 
acterized by including: encoding means for generating 
each of AV streams forming a plurality of reproduction 
paths; managing information generating means for gen- 
erating managing information including map information 
indicating positions of entry points of each of the AV 
streams and reproduction managing information indi- 
cating reproduction path change points set on the basis 
of the entry points included in the map information; and 
recording means for recording the AV streams and the 
managing information onto a recording medium. 
[0011] The managing information generating means 
can generate a correspondence table describing corre- 
spondences between packet numbers and presentation 
time stamps of the entry points as the map information. 
[0012] The encoding means can generate the AV 
streams one for each of the reproduction paths, and the 
managing information generating means can generate 
the map information and the reproduction managing in- 
formation regarding all the AV streams generated one 
for each of the reproduction paths as one correspond- 
ence table. 

[0013] The managing information generating means 
can generate the map information and the reproduction 
managing information regarding the AV streams gener- 
ated one for each of the reproduction paths separately 
for each of the reproduction paths. 
[0014] The managing information generated by the 
managing information generating means can include in- 
formation for specifying each of the AV streams gener- 
ated one for each of the reproduction paths and infor- 
mation for specifying a section where a plurality of the 
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reproduction paths are present. 

[0015] The encoding means can perform encoding 
such that a video stream of each section starting at the 
reproduction path change point is a Closed GOP start- 
ing with an l-picture and a first packet is a video packet, 
and the AV streams generated by the encoding means 
can be included in a transport stream. 
[001 6] The encoding means can set an identical value 
as a video packet ID of the transport stream and an iden- 
tical value as an audio packet ID of the transport stream 
in all the reproduction paths. 

[001 7] The information processing apparatus can fur- 
ther include source-packetizing means for source-pack- 
etizing the transport stream of each section, and the re- 
cording means can record the transport stream of each 
section source-packetized by the source-packetizing 
means as an AV stream file on the recording medium. 
[001 8] When recording the AV streams on the record- 
ing medium, the recording means can record the AV 
streams after interleaving the AV streams such that the 
sections of the reproduction paths are in predetermined 
order. 

[001 9] When recording the AV streams on the record- 
ing medium, the recording means can record the AV 
streams such that a plurality of sections of an identical 
reproduction path are continuous with each other. 
[0020] The reproduction managing information can 
include change information indicating whether repro- 
duction paths can be changed at the entry points. 
[0021] According to the present invention, there is 
provided a second information processing method char- 
acterized by including: an encoding step of generating 
each of AV streams forming a plurality of reproduction 
paths; a managing information generating step of gen- 
erating managing information including map information 
indicating positions of entry points of each of the AV 
streams and reproduction managing information indi- 
cating reproduction path change points set on the basis 
of the entry points included in the map information; and 
a recording step of recording the AV streams and the 
managing information onto a recording medium. 
[0022] Accordirg to the present invention, there is 
provided a program recorded on a first program storing 
medium, the program making a computer perform 
processing characterized by including: an encoding 
step of generating each of AV streams forming a plurality 
of reproduction paths; a managing information generat- 
ing step of generating managing information including 
map information indicating positions of entry points of 
each of the AV streams and reproduction managing in- 
formation indicating reproduction path change points 
set on the basis of the entry points included in the map 
information; and a recording step of recording the AV 
streams and the managing information onto a recording 
medium. 

[0023] According to the present invention, there is 
provided a first program characterized by making a com- 
puter perform processing including: an encoding step of 



generating each of AV streams forming a plurality of re- 
production paths; a managing information generating 
step of generating managing information including map 
information indicating positions of entry points of each 

5 of the AV streams and reproduction managing informa- 
tion indicating reproduction path change points set on 
the basis of the entry points included in the map infor- 
mation; and a recording step of recording the AV 
streams and the managing information onto a recording 

10 medium. 

[0024] According to the present invention, there is 
provided a second information processing apparatus 
characterized by including: reading means for reading 
reproduction managing information given to each repro- 

15 duction path having each section divided by a reproduc- 
tion path change point of an AV stream as a unit, and 
reading map information including a correspondence ta- 
ble describing a correspondence between a packet 
number and a presentation time stamp of the change 

20 point of the AV stream ; reproducing means for reproduc- 
ing the AV streams recorded on a recording medium on 
the basis of the reproduction managing information read 
by the reading means; retrieving means for, when an 
instruction to make a reproduction path change is given, 

25 retrieving the reproduction managing information of a 
reproduction path from which to make the reproduction 
path change and the reproduction managing informa- 
tion of a reproduction path to which to make the repro- 
duction path change; first obtaining means for obtaining 

30 a reproduction end position of the AV stream of the re- 
production path from which to make the reproduction 
path change on the basis of the reproduction managing 
information of the reproduction path from which to make 
the reproduction path change and the correspondence 

35 table of the reproduction path from which to make the 
reproduction path change; second obtaining means for 
obtaining a reproduction start position of the AV stream 
of the reproduction path to which to make the reproduc- 
tion path change on the basis of the reproduction man- 

40 aging information of the reproduction path to which to 
make the reproduction path change and the corre- 
spondence table of the reproduction path to which to 
make the reproduction path change; and control means 
for controlling the reproducing means to move a repro- 

45 ducing point at the reproduction end position to the re- 
production start position. 

[0025] According to the present invention, there is 
provided a second information processing method char- 
acterized by including: a reading step of reading repro- 

50 duction managing information given to each reproduc- 
tion path having each section divided by a reproduction 
path change point of an AV stream as a unit, and reading 
map information including a correspondence table de- 
scribing a correspondence between a packet number 

55 and a presentation time stamp of the change point of 
the AV stream; a reproducing step of reproducing the 
AV streams recorded on a recording medium on the ba- 
sis of the reproduction managing information read by 
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processing of the reading step; a retrieving step of, when 
an instruction to make a reproduction path change is giv- 
en, retrieving the reproduction managing information of 
a reproduction path from which to make the reproduc- 
tion path change and the reproduction managing infor- 
mation of a reproduction path to which to make the re- 
production path change; a first obtaining step of obtain- 
ing a reproduction end position of the AV stream of the 
reproduction path from which to make the reproduction 
path change on the basis of the reproduction managing 
information of the reproduction path from which to make 
the reproduction path change and the correspondence 
table of the reproduction path from which to make the 
reproduction path change; a second obtaining step of 
obtaining a reproduction start position of the AV stream 
of the reproduction path to which to make the reproduc- 
tion path change on the basis of the reproduction man- 
aging information of the reproduction path to which to 
make the reproduction path change and the corre- 
spondence table of the reproduction path to which to 
make the reproduction path change; and a control step 
of controlling processing of the reproducing step to 
move a reproducing point at the reproduction end posi- 
tion to the reproduction start position. 
[0026] According to the present invention, there is 
provided a program recorded on a second program stor- 
ing medium, the program making a computer perform 
processing characterized by including: a reading step of 
reading reproduction managing information given to 
each reproduction path having each section divided by 
a reproduction path change point of an AV stream as a 
unit, and reading map information including a corre- 
spondence table describing a correspondence between 
a packet number and a presentation time stamp of the 
change point of the AV stream; a reproducing step of 
reproducing the AV streams recorded on a recording 
medium on the basis of the reproduction managing in- 
formation read by processing of the reading step; a re- 
trieving step of, when an instruction to make a reproduc- 
tion path change is given, retrieving the reproduction 
managing information of a reproduction path from which 
to make the reproduction path change and the repro- 
duction managing information of a reproduction path to 
which to make the reproduction path change; a first ob- 
taining step of obtaining a reproduction end position of 
the AV stream of the reproduction path from which to 
make the reproduction path change on the basis of the 
reproduction managing information of the reproduction 
path from which to make the reproduction path change 
and the correspondence table of the reproduction path 
from which to make the reproduction path change; a 
second obtaining step of obtaining a reproduction start 
position of the AV stream of the reproduction path to 
which to make the reproduction path change on the ba- 
sis of the reproduction managing information of the re- 
production path to which to make the reproduction path 
change and the correspondence table of the reproduc- 
tion path to which to make the reproduction path 



change; and a control step of controlling processing of 
the reproducing step to move a reproducing point at the 
reproduction end position to the reproduction start po- 
sition. 

5 [0027] According to the present invention, there is 
provided a second program characterized by making a 
computer perform: a reading step of reading reproduc- 
tion managing information given to each reproduction 
path having each section divided by a reproduction path 
10 change point of an AV stream as a unit, and reading map 
information including a correspondence table describ- 
ing a correspondence between a packet number and a 
presentation time stamp of the change point of the AV 
stream; a reproducing step of reproducing the AV 
15 streams recorded on a recording medium on the basis 
of the reproduction managing information read by 
processing of the reading step; a retrieving step of, when 
an instruction to make a reproduction path change is giv- 
en, retrieving the reproduction managing information of 
20 a reproduction path from which to make the reproduc- 
tion path change and the reproduction managing infor- 
mation of a reproduction path to which to make the re- 
production path change; a first obtaining step of obtain- 
ing a reproduction end position of the AV stream of the 
25 reproduction path from which to make the reproduction 
path change on the basis of the reproduction managing 
information of the reproduction path from which to make 
the reproduction path change and the correspondence 
table of the reproduction path from which to make the 
30 reproduction path change; a second obtaining step of 
obtaining a reproduction start position of the AV stream 
of the reproduction path to which to make the reproduc- 
tion path change on the basis of the reproduction man- 
aging information of the reproduction path to which to 
35 make the reproduction path change and the corre- 
spondence table of the reproduction path to which to 
make the reproduction path change; and a control step 
of controlling processing of the reproducing step to 
move a reproducing point at the reproduction end posi- 
40 tion to the reproduction start position. 

[0028] According to the present invention, there is 
provided a third information processing apparatus char- 
acterized by including: encoding means for generating 
each of AV streams forming a plurality of reproduction 
45 paths; managing information generating means for gen- 
erating managing information including map information 
indicating a start point of the AV stream of each repro- 
duction path and positions of entry points of the AV 
stream, and reproduction managing information includ- 
ed ing the start point and an end point of the AV stream, 
reproduction path change points included in the entry 
points included in the map information, and specifying 
information for specifying the AV stream of each repro- 
duction path; and recording means for recording the AV 
55 streams and the managing information onto a recording 
medium. 

[0029] The managing information generating means 
can generate a correspondence table describing corre- 
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spondences betv/een packet numbers and presentation 
time stamps of the entry points as the map information. 
[0030] The encoding means can generate the AV 
streams one for each of the reproduction paths, and the 
managing information generating means can generate 
the map information and the reproduction managing in- 
formation regarding all the AV streams generated one 
for each of the reproduction paths as one correspond- 
ence table. 

[0031] The managing information generating means 
can generate the map information and the reproduction 
managing information regarding the AV streams gener- 
ated one for each of the reproduction paths separately 
for each of the reproduction paths. 
[0032] The managing information generated by the 
managing information generating means can include in- 
formation for specifying each of the AV streams gener- 
ated one for each of the reproduction paths and infor- 
mation for specifying a section where a plurality of the 
reproduction paths are present. 
[0033] The encoding means can perform encoding 
such that a video stream of each section starting at a 
reproduction path change point is a Closed GOP start- 
ing with an l-picture and a first packet is a video packet, 
and the AV streans generated by the encoding means 
can be included in a transport stream. 
[0034] The encoding means can perform encoding 
such that a start of the video stream of each section is 
the Closed GOP and a subsequent part of the video 
stream of each section is a non-Closed GOP. 
[0035] The information processing apparatus can fur- 
ther include source-packetizing means for source-pack- 
etizing the transport stream of each section, and the re- 
cording means can record the transport stream of each 
section source-packetized by the source-packetizing 
means as an AV stream file onto the recording medium. 
[0036] The managing information generating means 
can generate one correspondence table to be included 
in the map information, the correspondence table cor- 
responding to the AV stream file. 
[0037] When recording the AV streams on the record- 
ing medium, the recording means can record the AV 
streams after interleaving the AV streams such that the 
sections of the reproduction paths are in predetermined 
order. 

[0038] When recording the AV streams on the record- 
ing medium, the recording means can record the AV 
streams such that a plurality of sections of an identical 
reproduction path are continuous with each other. 
[0039] The reproduction managing information can 
include change information indicating whether repro- 
duction paths can be changed at the entry points. 
[0040] According to the present invention, there is 
provided a third information processing method charac- 
terized by including: an encoding step of generating 
each of AV streams forming a plurality of reproduction 
paths; a managing information generating step of gen- 
erating managing information including map information 



indicating a start point of the AV stream of each repro- 
duction path and positions of entry points of the AV 
stream and reproduction managing information includ- 
ing the start point and an end point of the AV stream, 

5 reproduction path change points included in the entry 
points included in the map information, and specifying 
information for specifying the AV stream of each repro- 
duction path; and a recording step of recording the AV 
streams and the managing information onto a recording 

10 medium. 

[0041] According to the present invention, there is 
provided a program recorded on a third program storing 
medium, the program making a computer perform 
processing characterized by including: an encoding 

15 step of generating each of AV streams forming a plurality 
of reproduction paths; a managing information generat- 
ing step of generating managing information including 
map information indicating a start point of the AV stream 
of each reproduction path and positions of entry points 

20 of the AV stream and reproduction managing informa- 
tion including the start point and an end point of the AV 
stream, reproduction path change points included in the 
entry points included in the map information, and spec- 
ifying information for specifying the AV stream of each 

25 reproduction path; and a recording step of recording the 
AV streams and the managing information onto a re- 
cording medium. 

[0042] According to the present invention, there is 
provided a third program characterized by making a 

30 computer perform: an encoding step of generating each 
of AV streams forming a plurality of reproduction paths; 
a managing information generating step of generating 
managing information including map information indi- 
cating a start point of the AV stream of each reproduction 

35 path and positions of entry points of the AV stream and 
reproduction managing information including the start 
point and an end point of the AV stream, reproduction 
path change points included in the entry points included 
in the map information, and specifying information for 

40 specifying the AV stream of each reproduction path; and 
a recording step of recording the AV streams and the 
managing information onto a recording medium. 
[0043] According to the present invention, there is 
provided a fourth information processing apparatus 

45 characterized by including: reading means for reading 
reproduction managing information including a repro- 
duction path change point of AV streams, a start point 
and an end point of the AV streams, and specifying in- 
formation for specifying the AV stream of each repro- 

50 duction path, and reading map information including a 
correspondence table describing correspondences be- 
tween packet numbers and presentation time stamps of 
the start point and the change point of the AV streams; 
reproducing means for reproducing the AV streams re- 

55 corded on a recording medium on the basis of the re- 
production managing information read by the reading 
means; retrieving means for, when an instruction to 
make a reproduction path change is given, retrieving a 
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section of a reproduction path from which to make the 
reproduction path change and a section of a reproduc- 
tion path to which to make the reproduction path 
change; first obtaining means for obtaining a reproduc- 
tion end position of the AV stream of the reproduction 
path from which to make the reproduction path change 
on the basis of the section of the reproduction path from 
which to make the reproduction path change and the 
correspondence table of the reproduction path from 
which to make the reproduction path change; second 
obtaining means for obtaining a reproduction start posi- 
tion of the AV stream of the reproduction path to which 
to make the reproduction path change on the basis of 
the section of the reproduction path to which to make 
the reproduction path change and the correspondence 
table of the reproduction path to which to make the re- 
production path change; and control means for control- 
ling the reproducing means to move a reproducing point 
at the reproduction end position to the reproduction start 
position. 

[0044] According to the present invention, there is 
provided a fourth information processing method char- 
acterized by including: a reading step of reading repro- 
duction managing information including a reproduction 
path change point of AV streams, a start point and an 
end point of the AV streams, and specifying information 
for specifying the AV stream of each reproduction path, 
and reading map information including a correspond- 
ence table describing correspondences between packet 
numbers and presentation time stamps of the start point 
and the change point of the AV streams; a reproducing 
step of reproducing the AV streams recorded on a re- 
cording medium on the basis of the reproduction man- 
aging information read by processing of the reading 
step; a retrieving step of, when an instruction to make a 
reproduction path change is given, retrieving a section 
of a reproduction path from which to make the reproduc- 
tion path change and a section of a reproduction path 
to which to make the reproduction path change; a first 
obtaining step of obtaining a reproduction end position 
of the AV stream of the reproduction path from which to 
make the reproduction path change on the basis of the 
section of the reproduction path from which to make the 
reproduction path change and the correspondence ta- 
ble of the reproduction path from which to make the re- 
production path change; a second obtaining step of ob- 
taining a reproduction start position of the AV stream of 
the reproduction path to which to make the reproduction 
path change on the basis of the section of the reproduc- 
tion path to which to make the reproduction path change 
and the correspondence table of the reproduction path 
to which to make the reproduction path change; and a 
control step of controlling processing of the reproducing 
step to move a reproducing point at the reproduction end 
position to the reproduction start position. 
[0045] According to the present invention, there is 
provided a program recorded on a fourth program stor- 
ing medium, the program making a computer perform 



processing characterized by including: a reading step of 
reading reproduction managing information including a 
reproduction path change point of AV streams, a start 
point and an end point of the AV streams, and specifying 

5 information for specifying the AV stream of each repro- 
duction path, and reading map information including a 
correspondence table describing correspondences be- 
tween packet numbers and presentation time stamps of 
the start point and the change point of the AV streams; 

10 a reproducing step of reproducing the AV streams re- 
corded on a recording medium on the basis of the re- 
production managing information read by processing of 
the reading step; a retrieving step of, when an instruction 
to make a reproduction path change is given, retrieving 

15 a section of a reproduction path from which to make the 
reproduction path change and a section of a reproduc- 
tion path to which to make the reproduction path 
change; a first obtaining step of obtaining a reproduction 
end position of the AV stream of the reproduction path 

20 from which to make the reproduction path change on 
the basis of the section of the reproduction path from 
which to make the reproduction path change and the 
correspondence table of the reproduction path from 
which to make the reproduction path change; a second 

25 obtaining step of obtaining a reproduction start position 
of the AV stream of the reproduction path to which to 
make the reproduction path change on the basis of the 
section of the reproduction path to which to make the 
reproduction path change and the correspondence ta- 

30 ble of the reproduction path to which to make the repro- 
duction path change; and a control step of controlling 
processing of the reproducing step to move a reproduc- 
ing point at the reproduction end position to the repro- 
duction start position. 

35 [0046] According to the present invention, there is 
provided a fourth program characterized by making a 
computer perform: a reading step of reading reproduc- 
tion managing information including a reproduction path 
change point of AV streams, a start point and an end 

40 point of the AV streams, and specifying information for 
specifying the AV stream of each reproduction path, and 
reading map information including a correspondence ta- 
ble describing correspondences between packet num- 
bers and presentation time stamps of the start point and 

45 the change point of the AV streams; a reproducing step 
of reproducing the AV streams recorded on a recording 
medium on the basis of the reproduction managing in- 
formation read by processing of the reading step; a re- 
trieving step of, when an instruction to make a reproduc- 

50 tion path change is given, retrieving a section of a re- 
production path from which to make the reproduction 
path change and a section of a reproduction path to 
which to make the reproduction path change; a first ob- 
taining step of obtaining a reproduction end position of 

55 the AV stream of the reproduction path from which to 
make the reproduction path change on the basis of the 
section of the reproduction path from which to make the 
reproduction path change and the correspondence ta- 
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ble of the reproduction path from which to make the re- 
production path change; a second obtaining step of ob- 
taining a reproduction start position of the AV stream of 
the reproduction path to which to make the reproduction 
path change on trie basis of the section of the reproduc- 
tion path to which to make the reproduction path change 
and the correspondence table of the reproduction path 
to which to make the reproduction path change; and a 
control step of controlling processing of the reproducing 
step to move a reoroducing point at the reproduction end 
position to the reproduction start position. 
[0047] According to the present invention, there is 
provided a first recording medium characterized in that 
data is recorded having a structure wherein reproduc- 
tion managing information includes information on a re- 
production path change point of AV streams and a start 
point and an end point of the AV streams, and map in- 
formation includes a correspondence table describing 
correspondences between packet numbers and pres- 
entation time stamps of the start point and the change 
point of the AV streams. 

[0048] According to the present invention, there is 
provided a second recording medium characterized in 
that data is recorded having a structure wherein repro- 
duction managing information includes a reproduction 
path change point of AV streams, a start point and an 
end point of the AV streams, and specifying information 
for specifying the AV stream of each reproduction path, 
and map information includes a correspondence table 
describing correspondences between packet numbers 
and presentation time stamps of the start point and the 
change point of the AV streams. 
[0049] Each of AV streams forming a plurality of re- 
production paths are generated, managing information 
including map information indicating positions of entry 
points of each of the AV streams and reproduction man- 
aging information indicating reproduction path change 
points set on the basis of the entry points included in the 
map information is generated, and the AV streams and 
the managing information are recorded onto a recording 
medium. 

[0050] Reproduction managing information given to 
each reproduction path having each section divided by 
a reproduction path change point of an AV stream as a 
unit is read and map information including a correspond- 
ence table describing a correspondence between a 
packet number and a presentation time stamp of the 
change point of the AV stream is read, the AV stream 
recorded on a recording medium is reproduced on the 
basis of the read reproduction managing information, 
when an instruction to make a reproduction path change 
is given, the reproduction managing information of a re- 
production path from which to make the reproduction 
path change and the reproduction managing informa- 
tion of a reproduction path to which to make the repro- 
duction path change are retrieved, a reproduction end 
position of the AV stream of the reproduction path from 
which to make the reproduction path change is obtained 



on the basis of the reproduction managing information 
of the reproduction path from which to make the repro- 
duction path change and the correspondence table of 
the reproduction path from which to make the reproduc- 

5 tion path change, a reproduction start position of the AV 
stream of the reproduction path to which to make the 
reproduction path change is obtained on the basis of the 
reproduction managing information of the path and the 
correspondence table of the reproduction path to which 

10 to make the reproduction path change, and the repro- 
duction is controlled to move a reproducing point at the 
reproduction end position to the reproduction start po- 
sition. 

[0051] Each of AV streams forming a plurality of re- 
15 production paths is generated, managing information in- 
cluding map information indicating a start point of the 
AV stream of each reproduction path and positions of 
entry points of the AV stream and reproduction manag- 
ing information including the start point and an end point 
of the AV stream, reproduction path change points in- 
cluded in the entry points included in the map informa- 
tion, and specifying information for specifying the AV 
stream of each reproduction path is generated, and the 
AV streams and the managing information are recorded 
onto a recording medium. 

[0052] Reproduction managing information including 
a reproduction path change point of AV streams, a start 
point and an end point of the AV streams, and specifying 
information for specifying the AV stream of each repro- 
duction path is read and map information including a 
correspondence table describing correspondences be- 
tween packet numbers and presentation time stamps of 
the start point and the change point of the AV streams 
is read, the AV stream recorded on a recording medium 
is reproduced on the basis of the read reproduction 
managing information, when an instruction to make a 
reproduction path change is given, a section of a repro- 
duction path from which to make the reproduction path 
change and a section of a reproduction path to which to 
make the reproduction path change are retrieved, a re- 
production end position of the AV stream of the repro- 
duction path from which to make the reproduction path 
change is obtained on the basis of the section of the 
reproduction path from which to make the reproduction 
path change and the correspondence table of the repro- 
duction path from which to make the reproduction path 
change, a reproduction start position of the AV stream 
of the reproduction path to which to make the reproduc- 
tion path change is obtained on the basis of the section 
of the reproduction path to which to make the reproduc- 
tion path change and the correspondence table of the 
reproduction path to which to make the reproduction 
path change, and the reproduction is controlled to move 
a reproducing point at the reproduction end position to 
the reproduction start position. 

[0053] Data is recorded having a structure wherein re- 
production managing information includes information 
on a reproduction path change point of AV streams and 
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a start point and an end point of the AV streams, and 
entity managing information includes a correspondence 
table describing correspondences between packet 
numbers and presentation time stamps of the start point 
and the change point of the AV streams. 
[0054] Data is recorded having a structure wherein re- 
production managing information includes a reproduc- 
tion path change point of AV streams, a start point and 
an end point of the AV streams, and specifying informa- 
tion for specifying the AV stream of each reproduction 
path, and entity managing information includes a corre- 
spondence table describing correspondences between 
packet numbers and presentation time stamps of the 
start point and the change point of the AV streams. 

Brief Description of Drawings 

[0055] 

FIG. 1 is a diagram of assistance in explaining a 
multiangle format of a DVD video; 
FIG. 2 is a block diagram showing an internal con- 
figuration of a recording and reproducing apparatus 
to which the present invention is applied; 
FIG. 3 is a diagram of assistance in explaining a 
structure of an application format on a recording 
medium used in an embodiment of the present in- 
vention; 

FIG. 4 is a diagram showing a structure of an AV 
stream file; 

FIG. 5 is a diagram of assistance in explaining 
seamless angle change reproduction in a multian- 
gle; 

FIG. 6 is a flowchart of assistance in explaining 
processing in seamless angle change in a multian- 
gle; 

FIG. 7 is a diagram showing data contents of Clip 
Information files; 

FIG. 8 is a flowchart of assistance in explaining 
processing for determining data reading addresses 
using EP_maps; 

FIG. 9 is a diagram of assistance in explaining a 

method of multiplexing and recording Clips; 

FIG. 10 is a diagram of assistance in explaining a 

method of multiplexing and recording Clips; 

FIG. 11 is a diagram showing data contents of Clip 

Information files; 

FIG. 12 is a diagram showing data contents of Clip 
Information files in the case of FIG. 10; 
FIG. 13 is a flowchart of assistance in explaining 
processing for recording AV signals used in a multi- 
angle; 

FIG. 14 is a flowchart of assistance in explaining 
processing for reproducing recorded multiangle AV 
stream data; 

FIG. 15 is a diagram showing an example of struc- 
ture of a PlayList; 

FIG. 1 6 is a diagram showing a syntax of a Playltem 



in FIG. 15; 

FIG. 17 is a flowchart of assistance in explaining 
reproduction processing 1 for reproducing recorded 
multiangle AV stream data; 

5 FIG. 1 8 is a diagram showing an example of another 

structure of an AV stream file; 
FIG. 1 9 is a diagram showing an example of another 
structure of an AV stream file; 
FIG. 20 is a diagram showing data contents of a Clip 

10 Information file in the case of FIG. 19; 

FIG. 21 is a diagram showing a syntax of a Playltem 
in managing a Clip AV stream file in FIG. 20; 
FIG. 22 is a flowchart of assistance in explaining 
processing for determining data reading addresses 

15 using an EP_map in FIG. 20; 

FIG. 23 is a diagram of assistance in explaining an- 
other method of multiplexing and recording Clips; 
FIG. 24 is a diagram showing a syntax of a Playltem 
in FIG. 23; 

20 FIG. 25 is a flowchart of assistance in explaining 
reproduction processing 2; and 
FIG. 26 is a block diagram showing an example of 
configuration of a personal computer. 

25 Best Mode for Carrying out the Invention 

[0056] Preferred embodiments of the present inven- 
tion will hereinafter be described with reference to the 
drawings. 

30 [0057] FIG. 2 shows an internal configuration of a re- 
cording and reproducing apparatus 1 to which the 
present invention is applied. 

[0058] Description will first be made of a configuration 
of a recording unit 2 for performing operation of record- 
35 ing an externally inputted signal onto a recording medi- 
um. The recording and reproducing apparatus 1 is con- 
figured to be able to receive and record analog data or 
digital data. 

[0059] An analog video signal is inputted to a terminal 
40 11 , and an analog audio signal is inputted to a terminal 
12. The video signal inputted to the terminal 11 is out- 
putted to an analyzing unit 14 and an AV encoder 15. 
The audio signal inputted to the terminal 1 2 is outputted 
to the analyzing unit 1 4 and the AV encoder 1 5. The an- 
45 alyzing unit 14 extracts scene change points and other 
characteristic points from the video signal and the audio 
signal inputted to the analyzing unit 14. 
[0060] The AV encoder 15 encodes the video signal 
and the audio signal inputted to the AV encoder 1 5. The 
50 AV encoder 15 outputs an encoded video stream (V), 
an encoded audio stream (A), and system information 
(S) for AV synchronization and the like to a multiplexer 
16. 

[0061] The encoded video stream is a video stream 
55 encoded by an MPEG (Moving Picture Expert Group) 2 
system, for example. The encoded audio stream is for 
example an audio stream encoded by an MPEG1 sys- 
tem, an audio stream encoded by a Dolby AC3 system 
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(trademark), or the like. The multiplexer 16 multiplexes 
the video and audio streams input to the multiplexer 1 6 
on the basis of the input system information, and then 
outputs the multiplexed stream to a multiplexed stream 
analyzing unit 1 8 and a source packetizer 1 9 via a switch 
17. 

[0062] The multiplexed stream is for example an 
MPEG2 transport stream or an MPEG2 program 
stream. The sou'ce packetizer 19 encodes the multi- 
plexed stream inputted to the source packetizer 19 into 
an AV stream including source packets according to an 
application format of a recording medium 1 00 for record- 
ing the stream. The AV stream is subjected to ECC (er- 
ror correction) code addition and modulation processing 
by an ECC coding unit 20 and a modulating unit 21 . The 
AV stream is then outputted to a writing unit 22. The writ- 
ing unit 22 writes (records) the AV stream file to the re- 
cording medium (disk) 100 formed by a DVD, for exam- 
ple, on the basis cf a control signal outputted from a con- 
trol unit 23. 

[0063] A transport stream of a digital television broad- 
cast or the like inputted from a digital interface or a digital 
television tuner (neither is shown) is inputted to a termi- 
nal 1 3. There are two methods of recording the transport 
stream inputted to the terminal 13: a method of record- 
ing the transport stream transparently and a method of 
recording the transport stream after re-encoding the 
transport stream for purposes of lowering a recording 
bit rate and the like. Information for specifying the re- 
cording method is inputted from a terminal 24 as a user 
interface to the control unit 23. 

[0064] When the input transport stream is to be re- 
corded transparently, the transport stream inputted to 
the terminal 13 is outputted to the multiplexed stream 
analyzing unit 18 and the source packetizer 19 via the 
switch 17. Subsequent processing until the AV stream 
is recorded onto t ie recording medium 100 is the same 
as in the above case of encoding and recording the input 
analog audio and video signals, and therefore descrip- 
tion of the subsequent processing will be omitted. 
[0065] When the input transport stream is to be re- 
encoded and ther recorded, the transport stream input- 
ted to the terminal 13 is inputted from a switch 25 to a 
demultiplexer 26. The demultiplexer 26 subjects the 
transport stream inputted thereto to demultiplex 
processing, and thereby extracts a video stream (V), an 
audio stream (A), and system information (S). 
[0066] Of the slreams (information) extracted by the 
demultiplexer 26, the video stream is outputted to an AV 
decoder 27, and the audio stream and the system infor- 
mation are outputted to the multiplexer 16. The AV de- 
coder 27 decodes the video stream inputted thereto, 
and then outputs a resulting reproduced video signal to 
the AV encoder 1 5. The AV encoder 1 5 encodes the in- 
put video signal, and then outputs an encoded video 
stream (V) to the multiplexer 16. 
[0067] The audio stream and the system information 
outputted from the demultiplexer 26 and inputted to the 



multiplexer 16 and the video stream outputted from the 
AV encoder 15 are multiplexed on the basis of the input 
system information, and then outputted as a multiplexed 
stream to the multiplexed stream analyzing unit 18 and 
5 the source packetizer 1 9 via the switch 1 7. Subsequent 
processing until the AV stream is recorded onto the re- 
cording medium 100 is the same as in the above case 
of encoding and recording the input analog audio and 
video signals, and therefore description of the subse- 

10 quent processing will be omitted. 

[0068] The recording and reproducing apparatus 1 
according to the present embodiment records an AV 
stream file onto the recording medium 100 and also 
records application database information used for re- 

15 production of the file and the like. The application data- 
base information is created by the control unit 23. Infor- 
mation inputted to the control unit 23 is moving image 
characteristic information from the analyzing unit 1 4, AV 
stream characteristic information from the multiplexed 

20 stream analyzing unit 18, and user instruction informa- 
tion inputted from the terminal 24. 
[0069] The moving image characteristic information 
supplied from the analyzing unit 14 is generated by the 
analyzing unit 14 when the AV encoder 15 encodes a 

25 video signal. The analyzing unit 14 analyzes contents 
of the input video signal and audio signal, and generates 
information related to characteristic images in the input 
moving image signal. For example, the information is 
specifying information that specifies a start point of a 

30 program in the input video signal, a scene change point, 
a start point and an end point of a commercial or the 
like, and a characteristic image such as an image in- 
cluding a title or a telop or the like. In this case, such 
specifying information will be referred to as a clip mark. 

35 The clip mark may also include a thumbnail of the image. 
The clip mark further includes information on a point of 
change between a stereo audio signal and a monophon- 
ic audio signal, a section without sound, or the like. 
[0070] These pieces of image specifying information 

40 are inputted to the multiplexer 1 6 via the control unit 23. 
When multiplexing an encoded picture from the control 
unit 23 which picture is specified as a clip mark, the mul- 
tiplexer 1 6 returns information for identifying the encod- 
ed picture on the AV stream to the control unit 23. This 

45 information is specifically a PTS (Presentation Time 
Stamp) of the picture or address information of the en- 
coded picture on the AV stream. The control unit 23 
stores a type of the characteristic image and the infor- 
mation for identifying the encoded picture on the AV 

50 stream in association with each other. 

[0071 ] The AV stream characteristic information from 
the multiplexed stream analyzing unit 18 relates to in- 
formation on encoding of an AV stream to be recorded, 
and is generated by the multiplexed stream analyzing 

55 unit 1 8. For example, the AV stream characteristic infor- 
mation includes a time stamp and address information 
of an l-picture within the AV stream, information on a 
discontinuity of a system time clock, encoding parame- 
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ters of the AV stream, information on a point of change 
of the encoding parameters in the AV stream, and the 
like. When the transport stream inputted from the termi- 
nal 13 is to be recorded transparently, the multiplexed 
stream analyzing unit 1 8 detects a picture having a char- 
acteristic as described above from the input transport 
stream, and generates information for identifying a type 
of the picture and the picture specified by a clip mark. 
[0072] The user instruction information inputted from 
the terminal 24 includes information specifying a repro- 
ducing section specified by the user in the AV stream, 
characters describing contents in the reproducing sec- 
tion, information on a resume point or a bookmark set 
at a desired scene by the user, and the like. 
[0073] On the basis of the above input information, the 
control unit 23 creates an AV stream database (Clip In- 
formation), a database of PlayLists formed by grouping 
reproducing sections (Playltems) in the AV stream, in- 
formation (info.dvr) for managing contents recorded on 
the recording medium 100, and thumbnail information. 
As with an AV stream, the application database informa- 
tion including these pieces of information is processed 
by the ECC encoding unit 20 and the modulating unit 
21, and then inputted to the writing unit 22. The writing 
unit 22 records a database file onto the recording medi- 
um 100 on the basis of a control signal outputted from 
the control unit 23. 

[0074] Details of the above-mentioned application da- 
tabase information will be described later. 
[0075] When the AV stream file (a file of video data 
and audio data) and the application database informa- 
tion thus recorded on the recording medium 100 are to 
be reproduced by a reproducing unit 3, the control unit 
23 first instructs a reading unit 28 to read the application 
database information from the recording medium 100. 
The reading unit 28 reads the application database in- 
formation from the recording medium 100. The applica- 
tion database information is subjected to demodulation 
and error correction processing by a demodulating unit 
29 and an ECC decoding unit 30, and then inputted to 
the control unit 23. 

[0076] On the basis of the application database infor- 
mation, the control unit 23 outputs a list of PlayLists re- 
corded on the recording medium 100 to the user inter- 
face of the terminal 24. The user selects a PlayList de- 
sired to be reproduced from the list of the PlayLists, and 
thereby information on the PlayList specified for repro- 
duction is inputted from the terminal 24 to the control 
unit 23. The control unit 23 instructs the reading unit 28 
to read an AV stream file necessary for the reproduction 
of that PlayList. The reading unit 28 reads a correspond- 
ing AV stream from the recording medium 1 00 according 
to the instruction, and outputs the AV stream to the de- 
modulating unit 29. The AV stream inputted to the de- 
modulating unit 29 is demodulated by being subjected 
to predetermined processing, then processed by the 
ECC decoding unit 30, and outputted to a source de- 
packetizer 31. 



[0077] The source depacketizer 31 converts the AV 
stream in an application format after being read from the 
recording medium 100 and subjected to the predeter- 
mined processing into a stream that can be processed 

5 by the demultiplexer 26. The demultiplexer 26 outputs, 
to the AV decoder 27, a video stream (V), an audio 
stream (A), and system information (S) for AV synchro- 
nization and the like, which include a reproducing sec- 
tion (Playltem) of the AV stream specified by the control 

10 unit 23. The AV decoder 27 decodes the video stream 
and the audio stream, and then outputs a reproduced 
video signal and a reproduced audio signal from a ter- 
minal 32 and a terminal 33 corresponding to the repro- 
duced video signal and the reproduced audio signal, re- 

15 spectively. 

[0078] When information indicating random access 
reproduction or special reproduction is inputted from the 
terminal 24 as the user interface, the control unit 23 de- 
termines a position to read an AV stream from the re- 

20 cording medium 1 00 on the basis of contents of the AV 
stream database (Clip Information), and then instructs 
the reading unit 28 to read the AV stream. When a Play- 
List selected by the user is reproduced from a predeter- 
mined time, for example, the control unit 23 instructs the 

25 reading unit 28 to read data from an l-picture having a 
time stamp closest to the specified time. 
[0079] When the user selects a clip mark from pro- 
gram start points or scene change points stored in clip 
marks (ClipMarks) in Clip Information recorded attached 

30 to an AV stream (Clip) as an AV stream database form- 
ing application database information (for example, this 
operation is performed when a thumbnail picture list of 
the program start points or the scene change points 
stored in the ClipMarks is displayed on the user interface 

35 and the user selects a picture from the thumbnail picture 
list), the control unit 23 determines a position to read the 
AV stream from the recording medium 100 on the basis 
of contents of the Clip Information, and then instructs 
the reading unit 28 to read the AV stream. Specifically, 

40 the control unit 23 instructs the reading unit 28 to read 
data from an l-picture at an address closest to an ad- 
dress on the AV stream at which address of the picture 
selected by the user is stored. The reading unit 28 reads 
data from the specified address. The read data is sub- 

45 jected to processing by the demodulating unit 29, the 
ECC decoding unit 30, and the source depacketizer 31 , 
inputted to the demultiplexer 26, and then decoded by 
the AV decoder 27, whereby the AV data indicated by 
the address of the picture at the mark point is repro- 

50 duced. 

[0080] When an instruction for high-speed reproduc- 
tion (fast-forward playback) is given by the user, the con- 
trol unit 23 instructs the reading unit 28 to read l-picture 
data in the AV stream sequentially on the basis of the 
55 AV stream database (Clip Information). 

[0081] The reading unit 28 reads AV stream data from 
random access points specified as a position where an 
l-picture is recorded. The read data is subjected to 
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processing by the parts in the subsequent stage, and is 
thereby reproduced. 

[0082] Description will next be made of a case where 
the user edits an AV stream recorded on the recording 
medium 100. When the user desires to create a new 
reproduction path (new PlayList) by specifying repro- 
ducing sections in AV streams recorded on the record- 
ing medium 100, for example when the user desires to 
create a new reproduction path to reproduce a segment 
of a singer A from a song program A and then reproduce 
a segment of the singer A from a song program B con- 
tinuously, information of start points (IN points) and end 
points (OUT points) of the reproducing sections is input- 
ted from the terminal 24 as the user interface to the con- 
trol unit 23. The control unit 23 creates a database of a 
group (PlayList) cf the reproducing sections (Play Items) 
of the AV streams. 

[0083] When the user desires to erase a part of an AV 
stream recorded on the recording medium 1 00, informa- 
tion of an IN point and an OUT point of the section to be 
erased is inputted from the terminal 24 as the user in- 
terface to the control unit 23. The control unit 23 chang- 
es the PlayList database to refer to only necessary AV 
stream portions. In addition, the control unit 23 instructs 
the writing unit 22 to erase the unnecessary stream por- 
tion of the AV stream. 

[0084] Description will be made of a case where the 
user desires to create a new reproduction path by spec- 
ifying reproducing sections in AV streams recorded on 
the recording medium 100 and desires to connect the 
reproducing sections to each other seamlessly. In this 
case, the control unit 23 creates a database of a group 
(PlayList) of the reproducing sections (Playltems) of the 
AV streams, and further performs partial re-encoding 
and re-multiplexing of video streams around a point of 
connection between the reproducing sections. 
[0085] First, information on pictures at an IN point and 
an OUT point of the reproducing sections is inputted 
from the terminal 24 to the control unit 23. The control 
unit 23 instructs the reading unit 28 to read data required 
to reproduce the pictures on the IN point side and pic- 
tures on the OUT point side. The reading unit 28 reads 
the data from the recording medium 100. The data is 
passed through the demodulating unit 29, the ECC de- 
coding unit 30, and the source depacketizer 31, and 
then outputted to the demultiplexer 26. 
[0086] The con :rol unit 23 analyzes the data inputted 
to the demultiplexer 26, and determines a re-encoding 
method (changing a picture_coding_type and assigning 
an amount of encoding bits for re-encoding) and a re- 
multiplexing method for the video stream. The control 
unit 23 then supplies the methods to the AV encoder 1 5 
and the multiplexer 16. 

[0087] Next, the? demultiplexer 26 separates the input 
stream into a video stream (V), an audio stream (A), and 
system information (S). The video stream includes data 
inputted to the AV decoder 27 and data inputted to the 
multiplexer 1 6. The former data is required for re-encod- 



ing. The data is decoded by the AV decoder 27, and de- 
coded pictures are re-encoded into a video stream by 
the AV encoder 15. The latter data is not re-encoded, 
and is copied from the original stream. The audio stream 
5 and the system information are inputted directly to the 
multiplexer 16. 

[0088] The multiplexer 16 multiplexes the input 
streams on the basis of the information inputted from 
the control unit 23, and then outputs a multiplexed 
10 stream. The multiplexed stream is processed by the 
ECC coding unit 20 and the modulating unit 21 , and then 
inputted to the writing unit 22. The writing unit 22 records 
the AV stream onto the recording medium 100 on the 
basis of a control signal supplied from the control unit 23. 
15 [0089] Description will be made below of the applica- 
tion database information and operations such as repro- 
duction, editing and the like based on the information. 
FIG. 3 schematically shows a structure of an application 
format on the recording medium 1 00 used in the embod- 
iment of the present invention. 

[0090] The application format has two layers, that is, 
a PlayList layer and a Clip layer to manage AV streams. 
Volume Information manages all Clips and PlayLists 
within the disk. In this case, a pair of one AV stream and 
information attached thereto is considered to be one ob- 
ject, and is referred to as a Clip. An AV stream file is 
referred to as a Clip AV stream file, and information at- 
tached thereto is referred to as a Clip Information file. 
[0091 ] One Clip AV stream file stores data in which an 
MPEG2 transport stream is arranged in a structure de- 
fined by the application format. In general, a file is han- 
dled as a byte string, while contents of the Clip AV 
stream file are extended on a time base and an entry 
point (l-picture) in the Clip is specified mainly on the time 
base. When a time stamp of a point of access (including 
an entry point) to a predetermined Clip is given, the Clip 
Information file helps find information on an address at 
which to start data reading in the Clip AV stream file. 
[0092] PlayLists will be described with reference to 
FIG. 3. PlayLists are provided to allow a user to select 
reproducing sections desired to be viewed by the user 
from Clips and easily edit the reproducing sections. One 
PlayList is a collection of reproducing sections in a Clip. 
One reproducing section in a given Clip is referred to as 
a Playltem, which is represented by a pair of an IN point 
and an OUT point on the time base. Thus, the PlayList 
is formed by a collection of one or more Playltems. 
[0093] There are two types of PlayLists. One is Real 
PlayList, and the other is Virtual PlayList. A Real Play- 
List shares the stream portion of a Clip that the Real 
PlayList refers to. That is, the Real PlayList occupies a 
data space in the disk which space corresponds to the 
stream portion of the Clip that the Real PlayList refers 
to. When the Real PlayList is erased, data of the stream 
portion of the Clip that the Real PlayList refers to is also 
erased. 

[0094] A Virtual PlayList does not share the data of a 
Clip. Even when a Virtual PlayList is changed or erased, 
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no change occurs in contents of Clips. 
[0095] Description will be made of a DVR MPEG-2 
transport stream. FIG. 4 shows a structure of an AV 
stream file. 

[0096] The AV stream file has a structure of a DVR 5 
MPEG2 transport stream. The DVR MPEG2 transport 
stream includes an integral number of Aligned units. 
Size of an Aligned unit is 6144 bytes (2048 x 3 bytes). 
An Aligned unit is started with a first byte of a source 
packet. A source packet has a length of 1 92 bytes. One 10 
source packet includes a TP_extra_header and a trans- 
port packet. The TP_extra_header has a length of four 
bytes, and the transport packet has a length of 188 
bytes. 

[0097] One Aligned unit includes 32 source packets. 15 
The last Aligned unit in the DVR MPEG2 transport 
stream also includes 32 source packets. Thus, the DVR 
MPEG2 transport stream is terminated at a boundary of 
the Aligned unit. When the number of transport packets 
of the input transport stream to be recorded on the re- 20 
cording medium (disk) 1 00 is not a multiple of 32, source 
packets having a null packet (transport packet with PID 
= 0x1 FFF) are used in the last Aligned unit. The file sys- 
tem (control unit 23) does not add extra information (ef- 
fective information) to the DVR MPEG2 transport 25 
stream. 

[0098] FIG. 5 shows a structure used in the present 
invention to enable multiangle reproduction to be per- 
formed seamlessly (without interruption of reproduced 
video or audio at a time of angle change) by changing 30 
angles. 

[0099] Suppose that there are three angles Angle#1 , 
Angle#2, and Angle#3 in a multiangle section. In this 
case, each angle forms one PlayList. In the example of 
FIG. 5, Angle#1, Angle#2, and Angle#3 are formed by 35 
PlayList#1, PlayList#2, and Playl_ist#3, respectively. 
Suppose that AV stream data corresponding to repro- 
ducing sections of Angle#1, Angle#2, and Angle#3 is 
Clip 1 (Clip AV stream 1), Clip 2 (Clip AV stream 2), and 
Clip 3 (Clip AV stream 3), respectively. *o 
[0100] In the example of FIG. 5, the reproducing sec- 
tions are divided into different Playltems by positions of 
timing that allows a change from one angle to another 
angle (angle change points). When the reproducing sec- 
tion of Angle#1 is divided into three sections, for exam- *5 
pie, PlayList#1 includes three Playltems corresponding 
to the reproducing sections a1, a2, and a3, and the AV 
stream data of Clip 1 corresponding to the reproducing 
sections a1 , a2, and a3 is A1 , A2, and A3, respectively. 
When the reproducing section of Angle#2 is divided into 50 
three sections, Playl_ist#2 includes three Playltems cor- 
responding to the reproducing sections b1 , b2, and b3, 
and the AV stream data of Clip 2 corresponding to the 
reproducing sections b1, b2, and b3 is B1, B2, and B3, 
respectively. When the reproducing section of Angle#3 55 
is divided into three sections, PlayList#3 includes three 
Playltems corresponding to the reproducing sections 
c1 , c2, and c3, and the AV stream data of Clip 3 corre- 



sponding to the reproducing sections c1, c2, and c3 is 
C1, C2, and C3, respectively 

[0101] The Playltems of the reproducing sections a1 , 
b1, and c1 have a set of the same IN point (IN_time) 
and the same OUT point (OUTJime). For example, the 
IN_time is T1, and the OUTJime is T2. Similarly, the 
Playltems of the reproducing sections a2, b2, and c2 
have a set of the same IN point (IN_time) and the same 
OUT point (OUT_time). For example, the IN_time is T2, 
and the OUTJime is T3. The Playltems of the reproduc- 
ing sections a3, b3, and c3 have a set of the same IN 
point (IN_time) and the same OUT point (OUTJime). 
For example, the IN_Jime is T3, and the OUTJime is 
T4. In this case, T1 , T2, T3, and T4 each denote a PTS 
(Presentation Time Stamp) on the AV streams. Inciden- 
tally, T1 , T2, T3, and T4 may be at equal intervals. 
[01 02] Basic processing in seamless angle change in 
a multiangle will be described with reference to a flow- 
chart of FIG. 6. 

[0103] In step S1, the control unit 23 determines 
whether an instruction to change an angle being repro- 
duced now is given from the user. When the control unit 
23 determines that no instruction to change the angle is 
given, the processing proceeds to step S2, where the 
control unit 23 determines whether an instruction to end 
the reproduction is given by the user. When the control 
unit 23 determines that an instruction to end the repro- 
duction is given, the processing is ended. 
[01 04] When the control unit 23 determines in step S2 
that no instruction to end the reproduction is given, the 
processing returns to step S1 to repeat the processing 
from step S1 on down. When the control unit 23 deter- 
mines in step S1 that an instruction to change the angle 
is given, the control unit 23 determines in step S3 wheth- 
er the reproducing position is an angle change point. 
When the current position is not an angle change point, 
the control unit 23 stands by until the reproducing posi- 
tion reaches an angle change point. 
[01 05] When the control unit 23 determines in step S3 
that the reproducing position has reached an angle 
change point, the control unit 23 changes (jumps) the 
reproducing position to a start position of an AV stream 
specified by the Playltem of the specified angle in step 
S4. Then, the data of the AV stream is reproduced. 
Thereafter the processing returns to step S1 to repeat 
the processing from step S1 on down. 
[0106] Thus, in the example of FIG. 5, the AV stream 
data A1 of Clip AV stream 1 corresponding to the repro- 
ducing section of Angle#1 is reproduced, the AV stream 
data B2 of Clip AV stream 2 corresponding to the repro- 
ducing section of Angle#2 is reproduced, and then the 
AV stream data C3 of Clip AV stream 3 corresponding 
to the reproducing section of Angle#3 is reproduced se- 
quentially. 

[0107] Information of a start address and an end ad- 
dress and information of data size (byte quantity) of the 
Playltems are obtained from a Clip Information file of the 
respective Clips. 
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[0108] FIG. 7 snows data contents of Clip Information 
files. 

[0109] Each piece of video stream data in the AV 
stream data A1, B1, and C1 starts with a Sequence 
header followed by a Closed GOP. A time stamp for 
starting display ol each piece of video stream data is the 
same, or T1 , and a period of display of each piece of 
video stream data is the same, or (T1-T2). The Closed 
GOP is closed within one section (for example the re- 
producing sections a1, b1, and d), and is encoded so 
as to be completed within the section. Of course, as long 
as the data is encoded so as to be completed within 
each section, that is, unless there is a predictive relation 
between one section (for example the reproducing sec- 
tion a1) and another section (for example the reproduc- 
ing section b1), the data does not need to be a GOP. 
[0110] Each piece of video stream data in the AV 
stream data A2, E2, and C2 also starts with a Sequence 
header followed by a Closed GOP A time stamp for 
starting display of each piece of video stream data is the 
same, or T2, anc a period of display of each piece of 
video stream data is the same, or (T2-T3). 
[0111] Each piece of video stream data in the AV 
stream data A3, B3, and C3 also starts with a Sequence 
header followed Dy a Closed GOP. A time stamp for 
starting display of each piece of video stream data is the 
same, or T3, and a period of display of each piece of 
video stream data is the same, or (T3-T4). Incidentally, 
a picture displayed first in the Closed GOP of the video 
stream data in all of the AV stream data A1 , B1 , C1 , A2, 
B2, C2, A3, B3, and C3 is an l-picture. 
[01 12] Audio stream data in the AV stream data A1 , 
B1, and C1 is the same. Audio stream data in the AV 
stream data A2, B2, and C2 is the same. Audio stream 
data in the AV stream data A3, B3, and C3 is the same. 
[0113] The AV stream data A1, B1, and C1 includes 
video packets and audio packets. A first packet of each 
of the pieces of AV stream data A1 , B1 , and C1 is a video 
packet. A payloacl of the video packet starts with an I- 
picture following a Sequence header and a GOP head- 
er. A first packet of each of the pieces of AV stream data 
A2, B2, and C2 is also a video packet. A payload of the 
video packet starts with an l-picture following a Se- 
quence header and a GOP header. A first packet of each 
of the pieces of AV stream data A3, B3, and C3 is also 
a video packet. A payload of the video packet starts with 
an l-picture following a Sequence header and a GOP 
header. 

[0114] Incidentally, each of the pieces of AV stream 
data A1, B1, and C1 may start with a packet including 
control information such as a PAT (Program Association 
Table), a PMT (Program Map Table) and the like, and 
have a video packet as a first subsequent elementary 
stream packet. 

[0115] A Clip Information file has an EP_map, which 
is a map describing correspondences between time 
stamps of entry points in the Clip and source packet 
numbers at which to start stream decoding in the Clip 



AV stream file. Incidentally, the source packet number 
is incremented by one in order of source packets in an 
AV stream file (FIG. 4). The source packet number of a 
first source packet in the file is zero. 

5 [0116] Supposing that first packet numbers of the 
pieces of AV stream data A1 , A2, and A3 are x1 , x2, and 
x3, that first packet numbers of the pieces of AV stream 
data B1, B2, and B3 are y1, y2, and y3, and that first 
packet numbers of the pieces of AV stream data C1 , C2, 

10 and C3 are z1 , z2, and z3, the EP_maps of Clip Infor- 
mation 1, 2, and 3 have contents as shown in FIG. 7. 
[01 1 7] In the EP_map of Clip Information 1 of Clip AV 
stream 1, payloads of source packets indicated by the 
numbers x1 , x2, and x3 start with l-pictures whose time 

is stamps have display start times of T1 , T2, and T3, re- 
spectively. 

[0118] In the EP_map of Clip Information 2 of Clip AV 
stream 2, payloads of source packets indicated by the 
numbers y1 , y2, and y3 start with l-pictures whose time 
20 stamps have display start times of T1 , T2, and T3, re- 
spectively. 

[01 1 9] In the EP_map of Clip Information 3 of Clip AV 
stream 3, payloads of source packets indicated by the 
numbers z1 , z2, and z3 start with l-pictures whose time 
25 stamps have display start times of T1, T2, and T3, re- 
spectively. 

[01 20] With reference to a flowchart of FIG. 8, descrip- 
tion will next be made of processing for determining data 
reading addresses using the EP_maps by taking as an 

30 example a case of changing angles and thereby repro- 
ducing the reproducing section a1 defined by the first 
Playltem of Angle#1 , the reproducing section b2 defined 
by the second Playltem of Angle#2, and the reproducing 
section c3 defined by the third Playltem of Angle#3. 

35 [0121] In step S21, processing for changing a repro- 
duction path is performed. Specifically, in order to read 
the AV stream data A1 of the reproducing section cor- 
responding to the reproducing section a1 defined by the 
first Playltem of Angle#1, the control unit 23 obtains a 

40 reading start address and a reading end address of the 
AV stream data A1 from the EP_map of Clip 1. In step 
S22, the control unit 23 reads the source packet number 
x1 corresponding to the time stamp T1 as the reading 
start address of the AV stream data A1 from the 

45 EP_map, and reads the source packet number x2 cor- 
responding to the time stamp T2 as the reading end ad- 
dress of the AV stream data A1 from the EP_map and 
further determines a source packet number (x2 - 1) im- 
mediately preceding the source packet number x2 as 

50 the reading end address of the AV stream data A1 . 
[01 22] In step S23, in order to read the AV stream data 
B2 of the reproducing section corresponding to the re- 
producing section b2 defined by the second Playltem of 
Angle#2, the control unit 23 obtains a reading start ad- 

55 dress T2 and a reading end address T3 of the AV stream 
data B2 from the EP_map of Clip 2. In step S24, the 
control unit 23 determines the source packet number y2 
corresponding to the time stamp T2 as the reading start 
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address of the AV stream data B2, and determines a 
source packet number (y3 - 1) immediately preceding 
the source packet number y3 corresponding to the time 
stamp T3 as the reading end address of the AV stream 
data B2. 

[01 23] In step S25, in order to read the AV stream data 
C3 of the reproducing section corresponding to the re- 
producing section c3 defined by the third Play Item of An- 
gle#3, the control unit 23 obtains a reading start address 
T3 and a reading end address T4 of the AV stream data 
C3 from the EP_map of Clip 3. In step S26, the control 
unit 23 determines the source packet number z3 corre- 
sponding to the time stamp T3 as the reading start ad- 
dress of the AV stream data C3, and determines a last 
source packet number of Clip 3 as the reading end ad- 
dress of the AV stream data C3. 
[0124] FIG. 9 is a diagram of assistance in explaining 
a method of multiplexing Clips and recording the Clips 
on a disk. 

[0125] When AV stream data corresponding to Play- 
Items of angles including a multiangle is recorded on the 
recording medium 100, it is desirable to divide the AV 
stream data of the angles into pieces of data in prede- 
termined sections, interleave the pieces of data, and 
then record the pieces of data in such an order as A1, 
B1, C1, A2, B2, C2, A3, B3, and C3, as shown in FIG. 
9. This minimizes a jump time when angle change is 
made at each Playltem. 

[01 26] FIG. 1 0 is a diagram of assistance in explaining 
another method of multiplexing Clips and recording the 
Clips on a disk. 

[0127] When AV stream data corresponding to Play- 
Items of angles including a multiangle is recorded on the 
recording medium 1 00, the AV stream data of the angles 
is interleaved and recorded in units of a plurality of (in 
the example of FIG. 1 0, three) pieces of continuous data 
in the AV stream data of the same angle (in units of "A1 , 
A2, and A3," "B1, B2, and B3," and "C1, C2, and C3, M 
for example), in such an order as A1, A2, A3, B1, B2, 
B3, C1 , C2, and C3, for example, as shown in FIG. 10. 
When the AV stream data interleaved and recorded as 
shown in FIG. 10 is reproduced with angle change, ad- 
dresses of angle change points (for example source 
packet numbers x1, x2, x3, ... corresponding to time 
stamps T1 , T2, T3, ... as reading start addresses of the 
AV stream data A1, A2, A3, ... in FIG. 11) are obtained 
from EP_maps of the AV streams as in FIG. 7, as shown 
in FIG. 11. 

[0128] Thereby, as compared with the example of 
FIG. 9, although a jump time when angles are changed 
at each Playltem is increased, an amount of data for 
managing the fragmented file data can be reduced. For 
example, the example of FIG. 1 0 can reduce the amount 
of data for managing the fragmented file data to 1/3 as 
compared with the example of FIG. 9. 
[0129] Thus, when recording multiangle AV stream 
data on the recording medium (disk) 100, the user can 
select the methods of multiplexing and recording Clips 



as described with reference to FIG. 9 and FIG. 10 in ad- 
vance according to whether the user gives priority to the 
access speed of a drive in the reproduction of the re- 
cording medium 1 00 or the amount of data for managing 

5 file data, and interleave and record AV stream data of 
angles by a selected predetermined recording method. 
[0130] In the example of FIG. 1 1 , entry points entered 
in the EP_maps are all angle change points. When entry 
points entered in EP_maps include entry points that are 

10 not angle change points, for each entry point in the 
EP_maps, a flag indicating whether the entry point is an 
angle change point may be recorded in the EP_maps 
as shown in FIG. 12. 

[0131] As shown in FIG. 12, each entry point in the 
15 EP_map (EP_map of Clip Information 1 in FIG. 12) of 
Clip 1 (Clip AV stream 1) has field data of 
is_AngleChange_point, PTS_EP_start, and SPN_EP_ 
start. 

[0132] The is_AngleChange_point indicates whether 
20 angle change is possible at the entry point. The 
SPN_EP_start indicates a packet number of the entry 
point. The PTS_EP_start indicates a display start time 
of the entry point. 

[0133] For example, entry points whose SPNL 
25 EP_start is x1 , x2, or x3 allow angle change, and there- 
fore the is_AngleChange_point of the entry points is "1 ." 
Entry points whose SPN_EP_start is x11 or x12 do not 
allow angle change, and therefore the is_ 
AngleChange_point of the entry points is "0." In other 
30 words, the is_AngleChange_point means that even 
when angle change is made at an entry point whose 
is_AngleChange_point is "0," seamless change is not 
ensured, that is, continuous supply of AV stream data 
at a predetermined bit rate is not ensured. 
35 [0134] The same applies to the EP_map (EP_map of 
Clip Information 2 in FIG. 12) of Clip 2 (Clip AV stream 

2) . Entry points whose SPN_EP_start is y1, y2, or y3 
allow angle change, and therefore the is_ 
AngleChange_point of the entry points is "1 ." 

40 [0135] The same applies to the EP_map (EP_map of 
Clip Information 3 in FIG. 12) of Clip 3 (Clip AV stream 

3) . Entry points whose SPN_EP_start is z1, z2, or z3 
allow angle change, and therefore the is_ 
AngleChange_point of the entry points is "1 ." 

45 [0136] When the AV stream data interleaved and re- 
corded as shown in FIG. 10 is reproduced with angle 
change, addresses of angle change points (for example 
the source packet numbers x1 , x2, x3, ... corresponding 
to time stamps T1 , T2, T3, ... as reading start addresses 

so of the AV stream data A1, A2, A3, ... in FIG. 12) are ob- 
tained from the EP_maps of the AV streams as in FIG. 
7, as shown in FIG. 12. 

[0137] Processing for recording AV signals used in a 
multiangle onto the recording medium 100 will next be 
55 described with reference to a flowchart of FIG. 13. 
[0138] In step S41, the control unit 23 instructs the 
user via the user interface 24 to divide a section of each 
angle for forming the multiangle into a plurality of pre- 
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determined sections. On the basis of the instruction, the 
user inputs an instruction to divide the whole section of 
each angle by change points. The control unit 23 obtains 
the instruction. In step S42, the AV encoder 1 5 encodes 
a video signal of each of the divided sections into a video 5 
stream starting with a Closed GOP, and encodes an au- 
dio signal of each of the sections into an audio stream. 
This encode processing is performed on video signals 
and audio signals of all angles. 

[0139] In step S43, the multiplexer 16 multiplexes the 10 
video stream and the audio stream of each section into 
a transport stream of each section. In step S44, the mul- 
tiplexer 16 interleaves the pieces of AV stream data of 
the angles in such an order as A1 , B1 , C1 , A2, B2, C2, 
A3, B3, and C3, for example. The multiplexer 16 per- 15 
forms the multiplexing such that a first packet is a video 
packet and the video packet starts with an l-picture of a 
Closed GOP. 

[0140] In step 345, the source packetizer 19 source- 
packetizes the transport stream of each predetermined 20 
section, and the writing unit 22 records the source-pack- 
etized transport stream as an AV stream file onto the 
recording medium 100. Thereby Clip AV stream files of 
the angles including the source-packetized and record- 
ed transport stream are generated on the recording me- 25 
dium 100. Incidentally, a video packet ID (PID) of the 
transport stream is the same in all the angles. An audio 
packet ID of the transport stream is also the same in all 
the angles. 

[0141] In step S46, the multiplexed stream analyzing 30 
unit 18 obtains a time stamp of a first l-picture of the 
transport stream of each section and a packet number 
of a packet whose payload starts with the l-picture. The 
control unit 23 adds a set of the time stamp and the pack- 
et number to an EP_map (When there is no EP_map, 35 
an EP_map is generated). 

[0142] In step S47, the control unit 23 controls the 
writing unit 22 to record the EP_map generated for each 
Clip AV stream file in a predetermined area of the re- 
cording medium 100 collectively (in a concentrated *o 
manner). 

[01 43] In step £ 48, the control unit 23 generates Play- 
Lists. In step S49 : the control unit 23 controls the writing 
unit 22 to record PlayList files representing the prede- 
termined sections in the form of Playltems and having 45 
such a data structure in a predetermined area of the re- 
cording medium 100 collectively (in a concentrated 
manner). Incidentally, in the case where entry points en- 
tered in the EP_maps include entry points that are not 
angle change points as shown in FIG. 12, angle change 50 
points are set on the basis of flags ("1" and "0") of the 
EP_maps as shown in FIG. 12 when the control unit 23 
generates the PlayLists in step S48. 
[0144] Processing for reproducing the thus recorded 
multiangle AV stream data will next be described with 55 
reference to a flowchart of FIG. 14. 
[0145] In step S61, the control unit 23 reads all the 
PlayList files forming the multiangle and the Clip Infor- 



mation file (including the EP_map) of a Clip that each 
PlayList refers to from the recording medium 100. That 
is, pre-reading is performed. The EP_maps are record- 
ed collectively, and can therefore be read quickly. 
[0146] In step S62, on the basis of a PlayList read in 
the processing of step S61 , the control unit 23 sequen- 
tially reproduces AV stream data from a position speci- 
fied by a first Playltem of the PlayList. In step S63, the 
control unit 23 determines whether the user has given 
an instruction to change angles via the user interface 
24. When the control unit 23 determines that the user 
has not given an instruction to change angles, the con- 
trol unit 23 determines in step S64 whether the user has 
given an instruction to end the reproduction. When the 
control unit 23 determines that the user has given an 
instruction to end the reproduction, the processing is 
ended. When the control unit 23 determines that the us- 
er has not given an instruction to end the reproduction, 
the processing returns to step S63. 
[0147] When the control unit 23 determines in step 
S63 that the user has given an instruction to change an- 
gles, the control unit 23 in step S65 retrieves a first Play- 
Item having a future display end time closest to a 
present reproduction time in the PlayList corresponding 
to an angle from which to make the angle change (angle 
currently being reproduced). When an instruction to 
change from Angle#1 to Angle#2 is given between the 
time stamps T1 and T2 in the example of FIG. 5, for ex- 
ample, the Playltem a1 is the target first Playltem. In 
step S66, the control unit 23 retrieves a second Playltem 
having the display end time of the first Playltem as a 
display start time in a PlayList corresponding to an angle 
to which to make the angle change. When an instruction 
to change from Angle#1 to Angle#2 is given between 
the time stamps T1 and T2 in the example of FIG. 5, for 
example, the Playltem b2 is the target second Playltem. 
[0148] In step S67, the control unit 23 obtains a 
source packet number corresponding to the display end 
time of the first Playltem by referring to the EP_map of 
the Clip that the first Playltem refers to, and sets a 
source packet immediately preceding the source packet 
number as a data reading end point of the angle from 
which to make the angle change. 
[0149] In step S68, the control unit 23 obtains a 
source packet number corresponding to the display start 
time of the second Playltem by referring to the EP_map 
of the Clip that the second Playltem refers to, and sets 
a source packet of the source packet number as a data 
reading start point of the angle to which to make the an- 
gle change. 

[0150] In step S69, the control unit 23 determines 
whether the present reproducing position is the end 
point calculated in the processing of step S67. When the 
present reproducing position is not the end point, the 
control unit 23 stands by until the present reproducing 
position reaches the end point. When the present repro- 
ducing position reaches the end point, the processing 
proceeds to step S70, where the control unit 23 jumps 
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the reproducing position to the start point calculated in 
the processing of step S68. Thereafter the processing 
returns to step S63 to repeat the processing from step 
S63 on down. 

[0151] FIG. 15 shows another example of a PlayList 
including a multiangle. 

[0152] In the example of FIG. 15, there is one multi- 
angle PlayList, and there is one Playltem in the PlayList. 
The Playltem has three pieces of information, for exam- 
ple. The first piece of information is information (speci- 
fying information) on AV streams used in multiangle re- 
production to which streams to make reference. For ex- 
ample, in the example of FIG. 1 5, Clip AV stream 1 , Clip 
AV stream 2, and Clip AV stream 3 are streams to which 
to make reference. Thus, the specifying information 
(pointer) specifies them. The second piece of informa- 
tion is an IN point (lN_time) and an OUT point 
(OUT_time) that indicate a time section of the multiangle 
reproduction. In the example of FIG. 15, IN_time = T1 
and OUT_time = T4. The third piece of information is 
times of entry points representing angle change points 
in the time section of the multiangle reproduction. In the 
example of FIG. 15, the times are T2 and T3. 
[0153] FIG. 16 shows a syntax of the Playltem in FIG. 
15. 

[0154] A Clip_information_file_name represents AV 
streams used in the multiangle reproduction to which 
streams to make reference. An IN_time and an 
OUT_time represent the time section of the multiangle 
reproduction. An entry_time [ i] is the time of an entry 
point allowing angle change in the time section of the 
multiangle reproduction. Of course, also in the case of 
the Playltem in FIG. 1 5 and FIG. 1 6, the three EP_maps 
described with reference to FIG. 7 are all used as they 
are for conversion from time to data addresses. 
[0155] Processing for recording AV signals used for 
the multiangle onto the recording medium 100 in the 
case where the PlayList and the Playltem are formed as 
shown in FIG. 1 5 and FIG. 1 6 is the same as in the case 
represented by the flowchart of FIG. 13, and therefore 
description thereof will be omitted. In this example, how- 
ever, the PlayLists generated in step S48 and recorded 
in step S49 are the PlayList file having the data structure 
that indicates the time of an entry point allowing angle 
change by the entry_time [ i]. 

[01 56] Reproduction processing 1 for reproducing the 
recorded multiangle in this example is as shown in FIG. 
17. Processing from step S91 to step S100 is basically 
the same as the processing from step S61 to step S70 
in FIG. 14. However, the control unit 23 detects a first 
reproducing section in the Playltem instead of the first 
Playltem in step S95, and detects a second reproducing 
section in the Playltem instead of the second Playltem 
in step S96. When an instruction to change from An- 
gle#1 to Angle#2 is given between time stamps T1 and 
T2 in the example of FIG. 15, for example, the first re- 
producing section is a reproducing section a1, and the 
second reproducing section is a reproducing section b2. 



[0157] In step S97, the control unit 23 obtains a 
source packet number corresponding to the display end 
time of a section corresponding to the first reproducing 
section by referring to the EP_map of a Clip that the sec- 

5 tion corresponding to the first reproducing section refers 
to. In step S98, the control unit 23 obtains a source pack- 
et number corresponding to the display start time of a 
section corresponding to the second reproducing sec- 
tion by referring to the EP_map of a Clip that the section 

10 corresponding to the second reproducing section refers 
to. The other processing is the same as in FIG. 14, and 
therefore description thereof will be omitted. Incidental- 
ly, a non-seamless signal that does not ensure seam- 
lessness may be mixed with a seamless signal within a 

15 multiangle. 

[01 58] FIG. 1 8 shows an example of another structure 
of an AV stream file. In the cases of FIG. 7 and FIG. 15, 
an EP_map (in the example of FIG. 7, the EP_map of 
Clip Information 1 for Clip AV stream 1 , the EP_map of 

20 clip Information 2 for Clip AV stream 2, and the EP_map 
of Clip Information 3 for Clip AV stream 3) is attached to 
each of Clip AV stream 1 , Clip AV stream 2, and Clip AV 
stream 3. In the case of FIG. 18, on the other hand, one 
EP_map is attached to three Clip AV streams (that is, 

25 Clip AV stream 1 , Clip AV stream 2, and Clip AV stream 
3), for example. 

[0159] In the example of FIG. 18, the AV stream file 
is interleaved in order of data pieces A1 , B1 , C1 , A2, B2, 
C2, A3, B3, and C3. A source packet number in the AV 
30 stream file is assigned to each source packet in the AV 
stream file sequentially (x1 , y1 , z1 , x2, y2, z2, x3, y3, z3 
in the example of FIG. 1 8) for each Clip AV stream (Clip 
AV stream 1 , Clip AV stream 2, and Clip AV stream 3). 
[01 60] Each of pieces of video stream data in the piec- 
es es of AV stream data A1 , B1 , C1 , A2, B2, C2, A3, B3, 
and C3 in FIG. 18 may include two or more GOPs. In 
such a case, a second GOP and subsequent GOPs may 
be GOPs that are not Closed GOPs (non-Closed 
GOPs). However, encoding needs to be completed with- 
40 jn each piece of AV stream data (for example the AV 
stream data A1 ). Suppose that the video stream data of 
the AV stream data A1 includes one Closed GOP and 
two non-Closed GOPs, for example. In this case, as 
shown in FIG. 19, source packet numbers x1, x11, and 
45 x12, for example, are assigned in the AV stream file, and 
source packets of the source packet numbers x11 and 
x12 correspond to the two non-Closed GOPs, respec- 
tively. 

[01 61] In the example of FIG. 1 9, the video stream da- 
50 ta of the piece of AV stream data B1 includes one Closed 
GOP and two non-Closed GOPs. Source packet num- 
bers y1 , y1 1 , and y1 2 are assigned in the AV stream file, 
and source packets of the source packet numbers y11 
and y12 are source packets of the two non-Closed 
55 GOPs, respectively. 

[0162] The video stream data of the piece of AV 
stream data C1 includes one Closed GOP and two 
non-Closed GOPs. Source packet numbers z1 , z1 1 , and 
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z12 are assigned in the AV stream file, and source pack- 
ets of the source packet numbers z11 and z12 are 
source packets of the two non-Closed GOPs, respec- 
tively. 

[0163] The same applies to the video stream data of 
the pieces of AV stream data A2, B2, C2, A3, B3, and 
C3 in FIG. 19. 

[01 64] FIG. 20 shows data contents of a Clip Informa- 
tion file in the case of FIG. 1 9. Contents of the AV stream 
data A1.B1.C1, A2, B2, C2, A3, B3, and C3 are basi- 
cally the same as in FIG. 7, and therefore description 
thereof will be omitted. 

[0165] As shov/n in FIG. 20, the Clip Information file 
attached to the AV stream file (Clip AV stream file X) has 
an EP_map, which is a map describing correspondenc- 
es between time stamps of entry points in the Clip and 
source packet numbers at which to start stream decod- 
ing in the Clip AV stream file. 

[0166] Each entry point in the EP_map has field data 
of is_AngleChange_point, Angle_number, PTS_EP_ 
start, and SPN_IEP_start. The is_AngleChange_point 
indicates whether angle change is possible at the entry 
point. The Angle_ number indicates an angle number to 
which the entry paint belongs. The SPN_EP_start indi- 
cates a packet number of the entry point. The 
PTS_EP_start indicates a display start time of the entry 
point. 

[0167] For example, entry points whose SPN_ 
EP_start is x1 , x2, or x3 allow angle change, and there- 
fore the is_AngleChange_point of the entry points is "1 ." 
Entry points whose SPN_EP_start is x11 or x12 do not 
allow angle change, and therefore the is_ 
AngleChange_point of the entry points is "0." In other 
words, the is_AngleChange_point means that even 
when angle change is made at an entry point whose 
is_AngleChange_.point is "0," seamless change is not 
ensured, that is, continuous supply of AV stream data 
at a predetermined bit rate is not ensured. The same 
applies to entry pc ints whose SPN_EP_start is y1 1 , y1 2, 
z11 orz12. 

[0168] FIG. 21 s hows a syntax of a Playltem when the 
Clip AV stream file is managed in FIG. 20. A 
Clip_information_file_name represents AV streams 
used in multiangle reproduction to which streams to 
make reference (Clip_information_X in the example of 
FIG. 21). An IN_time (T1 in the example of FIG. 21 ) and 
an OUT_time (T4 in the example of FIG. 21) represent 
a start point and an end point of a time section of the 
multiangle reproduction. Of course, in the case of the 
Playltem of FIG. 21, the EP_map described with refer- 
ence to FIG. 20 is used for conversion from time to data 
addresses 

[01 69] Thus, since Clip 1 , Clip 2, and Clip 3 are treated 
as one file, fragmentation of file data can be prevented, 
and therefore an amount of data in managing the data 
of the AV stream file can be reduced as compared with 
FIG. 7. 

[0170] With refe rence to a flowchart of FIG. 22, de- 



scription will next be made of processing for determining 
data reading addresses using the EP_map in FIG. 20 
by taking as an example a case of changing angles and 
thereby reproducing a reproducing section a1 defined 
5 by a first Playltem of Angle#1 , a reproducing section b2 
defined by a second Playltem of Angle#2, and a repro- 
ducing section c3 defined by a third Playltem of An- 
gle#3. 

[0171] In step S121, in order to read the AV stream 
to data A1 of the reproducing section corresponding to the 
reproducing section a1 defined by the first Playltem of 
Angle#1, the control unit 23 obtains a reading start ad- 
dress and a reading end address of the AV stream data 
A1 from data of entry points of Angle_number = 1 in the 
15 EP_map in FIG. 20. In step S122, the control unit 23 
reads the source packet number x1 corresponding to a 
time stamp T1 as the reading start address of the AV 
stream data A1 from the EP_map. In addition, the con- 
trol unit 23 reads the source packet number y1 corre- 
ct* sponding to a time stamp T1 of Angle_number = 2 from 
the EP_map and further determines a source packet 
number (y1 - 1 ) immediately preceding the source pack- 
et number y1 as the reading end address of the piece 
of AV stream data A1 . 
25 [0172] In step S123, in order to read the AV stream 
data B2 of the reproducing section corresponding to the 
reproducing section b2 defined by the second Playltem 
of Angle#2, the control unit 23 obtains a reading start 
address and a reading end address of the AV stream 
30 data B2 from data of entry points of Angle_number = 2 
in the EP_map in FIG. 20. In step S124, the control unit 
23 in step S 1 23 reads the source packet number y2 cor- 
responding to a time stamp T2 as the reading start ad- 
dress of the AV stream data B2 from the EP_map. In 
35 addition, the control unit 23 reads the source packet 
number z2 corresponding to a time stamp T2 of 
Angle_number = 3 from the EP_map and further deter- 
mines a source packet number (z2 - 1 ) immediately pre- 
ceding the source packet number z2 as the reading end 
40 address of the piece of AV stream data B2. 

[0173] In step S125, in order to read the AV stream 
data C3 of the reproducing section corresponding to the 
reproducing section c3 defined by the third Playltem of 
Angle#3, the control unit 23 obtains a reading start ad- 
45 dress and a reading end address of the AV stream data 
C3 from data of entry points of Angle_number = 3 in the 
EP_map in FIG. 20. In step S126, the control unit 23 
reads the source packet number z3 corresponding to a 
time stamp T3 as the reading start address of the AV 
50 stream data C3 from the EP_map. In addition, the con- 
trol unit 23 determines a last source packet number of 
Angle_number = 3 as the reading end address of the 
piece of AV stream data C3. 

[0174] FIG. 23 shows another example of a PlayList 
55 forming a multiangle. The PlayList shown in FIG. 23 is 
different from the PlayList of FIG. 15. 
[01 75] The PlayList in the example of FIG. 23 includes 
a multiangle type Playltem. The Playltem has two piec- 
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es of information, for example. The first piece of infor- 
mation is information (specifying information) on AV 
streams used in multiangle reproduction to which 
streams to make reference. For example, in the exam- 
ple of FIG. 23, Clip AV stream 1 , Clip AV stream 2, and 
Clip AV stream 3 are streams to which to make refer- 
ence. Thus, the specifying information (pointer) speci- 
fies them. The second piece of information is an IN point 
(IN_time) and an OUT point (OUTJime) that indicate a 
time section of the multiangle reproduction. In the ex- 
ample of FIG. 23, the IN point is IN_time = T1 and the 
OUT point is OUT_time. The IN_time and the OUT_time 
are shared by a plurality of AV streams used in the multi- 
angle reproduction. 

[0176] A method of interleaving and recording Clips 
is basically the same as described with reference to FIG. 
10. 

[01 77] Specifically, when AV stream data correspond- 
ing to Playltems of angles including the multiangle is re- 
corded on the recording medium 1 00, the AV stream da- 
ta of the angles is interleaved and recorded in units of 
a plurality of (in the example of FIG. 1 0, three) pieces of 
continuous data in the AV stream data of the same angle 
(in units of "A1 , A2, and A3," "B1 , B2, and B3," and "C1 , 
C2, and C3," for example), in such an order as A1 , A2, 
A3, B1 , B2, B3, C1 , C2, and C3, for example, as shown 
in FIG. 10. When the AV stream data interleaved and 
recorded as shown in FIG. 10 is reproduced with angle 
change, addresses of angle change points (for example 
source packet numbers x1, x2, x3, ... corresponding to 
time stamps T1, T2, T3, ... as reading start addresses 
of the AV stream data A1 , A2 5 A3, ... as described with 
reference to FIG. 12) are obtained from EP_mapsofthe 
AV streams, as shown in FIG. 12. 
[0178] As shown in FIG. 12, each entry point in the 
EP_map (EP_map of Clip Information 1 in FIG. 12) of 
Clip 1 (Clip AV stream 1) has field data of is_ 
AngleChange_point, PTS_EP_start, and SPN_EP_ 
start. 

[0179] The is_AngleChange_point indicates whether 
angle change is possible at the entry point. The 
SPN_EP_start indicates a packet number of the entry 
point. The PTS_EP_start indicates a display start time 
of the entry point. 

[0180] For example, entry points whose SPN_ 
EP_start is x1 , x2, or x3 allow angle change, and there- 
fore the is_AngleChange_point of the entry points is "1 ." 
Entry points whose SPN_EP_start is x11 or x12 do not 
allow angle change, and therefore the is_ 
AngleChange_point of the entry points is "0." In other 
words, the is_AngleChange_point means that even 
when angle change is made at an entry point whose 
is_AngleChange_point is "0," seamless change is not 
ensured, that is, continuous supply of AV stream data 
at a predetermined bit rate is not ensured. 
[0181] The same applies to the EP_map (EP_map of 
Clip Information 2 in FIG. 12) of Clip 2 (Clip AV stream 
2). Entry points whose SPN_EP_start is y1, y2, or y3 



allow angle change, and therefore the is_Angle- 
Change_point of the entry points is "1 ." 
[0182] The same applies to the EP_map (EP_map of 
Clip Information 3 in FIG. 12) of Clip 3 (Clip AV stream 
5 3). Entry points whose SPN_EP_start is z1, z2, or z3 
allow angle change, and therefore the is_Angle- 
Change_point of the entry points is "1 ." 
[0183] FIG. 24 shows a syntax of the Playltem in FIG. 
23. 

10 [0184] A Clip_informationJile_name represents the 
AV streams used in multiangle reproduction to which 
streams to make reference. An IN_time and an 
OUT_time represent the time section of the multiangle 
reproduction. 

15 [0185] Processing for recording AV signals used in 
the multiangle onto the recording medium 100 in the 
case described with reference to FIG. 23 and FIG. 24 is 
basically the same as described with reference to FIG. 
13. 

20 [01 86] Specifically, the control unit 23 instructs the us- 
er via the user interface 24 to divide a section of each 
angle for forming the multiangle into a plurality of pre- 
determined sections. On the basis of the instruction, the 
user inputs an instruction to divide the whole section of 

25 each angle by change points. The control unit 23 obtains 
the instruction. The AV encoder 1 5 encodes a video sig- 
nal of each of the divided sections into a video stream 
starting with a Closed GOP, and encodes an audio sig- 
nal of each of the sections into an audio stream. This 

30 encode processing is performed on video signals and 
audio signals of all angles. 

[0187] The multiplexer 16 multiplexes the video 
stream and the audio stream of each section into a 
transport stream of each section. The multiplexer 1 6 in- 

35 terleaves the AV stream data of the angles in a manner 
as shown in FIG. 10, for example. The multiplexer 16 
performs the multiplexing such that a first packet is a 
video packet and the video packet starts with an l-pic- 
ture of a Closed GOP. 

40 [0188] The source packetizer 19 source-packetizes 
the transport stream of each predetermined section, and 
the writing unit 22 records the source-packetized trans- 
port stream as an AV stream file onto the recording me- 
dium 100. Thereby Clip AV stream files of the angles 

45 including the source-packetized and recorded transport 
stream are generated on the recording medium 100. In- 
cidentally, a video packet ID (PID) of the transport 
stream is the same in all the angles. An audio packet ID 
of the transport stream is also the same in all the angles. 

50 [01 89] Then, the multiplexed stream analyzing unit 1 8 
obtains a time stamp of a first l-picture of the transport 
stream of each section and a packet number of a packet 
whose payload starts with the l-picture. The control unit 
23 adds a set of the time stamp and the packet number 

55 to an EP_map (When there is no EP_map, an EP_map 
is generated). 

[0190] Then, the control unit 23 controls the writing 
unit 22 to record the EP_map generated for each Clip 
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AV stream file in a predetermined area of the recording 
medium 100 collectively (in a concentrated manner). 
[0191] The control unit 23 generates a PiayList. 
Thereafter, the control unit 23 controls the writing unit 

22 to record a PiayList file representing the predeter- 5 
mined sections in the form of a Playltem and having 
such a data structure in a predetermined area of the re- 
cording medium 100 collectively (in a concentrated 
manner). Incidentally, in the case where entry points en- 
tered in the EP_maps include entry points that are not io 
angle change points as shown in FIG. 1 2, angle change 
points are set on the basis of flags ("1" and "0") of the 
EP_maps as shown in FIG. 12 when the control unit 23 
generates the PiayList. 

[0192] Reproduction processing 2 for reproducing the 15 
recorded multiangle in the example of FIG. 23 and FIG. 
24 will next be described with reference to FIG. 25. 
[01 93] In step S 1 41 , the control unit 23 reads the Play- 
List file and the Clip Information files (including the 
EP_maps) of a plurality of Clips that the multiangle type 20 
Playltem included in the PiayList refers to from the re- 
cording medium 1 00. That is, pre-reading is performed. 
The EP_maps are recorded collectively, and can there- 
fore be read quickly. 

[0194] In step S142, on the basis of the multiangle 25 
type Playltem included in the PiayList read in the 
processing of step S1 41 , the control unit 23 reproduces 
AV stream data. In step S143, the control unit 23 deter- 
mines whether the user has given an instruction to 
change angles via the user interface 24. When the con- 30 
trol unit 23 determines that the user has not given an 
instruction to change angles, the control unit 23 deter- 
mines in step S144 whether the user has given an in- 
struction to end the reproduction. When the control unit 

23 determines that the user has given an instruction to 35 
end the reproduction, the processing is ended. When 

the control unit 23 determines that the user has not given 
an instruction to end the reproduction, the processing 
returns to step Si 43. 

[0195] When the control unit 23 determines in step 40 
S143 that the user has given an instruction to change 
angles, the control unit 23 in step S145 retrieves a first 
reproducing sect on having a future display end time 
closest to a present reproduction time in reproducing 
sections of a Clip AV stream corresponding to an angle 45 
from which to make the angle change (angle currently 
being reproduced). When an instruction to change from 
Angle#1 to Angle#2 is given between the time stamps 
T1 and T2 in the example of FIG. 23, for example, a 
reproducing section a1 is the target first reproducing 50 
section. This is derived from the fact that the 
is_AngleChange„point at each of T1 and T2 in the 
EP_map of the Clip of Angle#1 is set to "1 ." 
[0196] In step S146, the control unit 23 retrieves a 
second reproduci ng section having the display end time 55 
of the first reproducing section as a display start time in 
reproducing sections of a Clip AV stream corresponding 
to an angle to which to make the angle change. When 



an instruction to change from Angle#1 to Angle#2 is giv- 
en between the time stamps T1 and T2 in the example 
of FIG. 23, for example, a reproducing section b2 is the 
target second reproducing section. This is derived from 
the fact that the is_AngleChange_point at each of T2 
and T3 in the EP_map of the Clip of Angle#2 is set to "1 ." 
[0197] In step S147, the control unit 23 obtains a 
source packet number corresponding to the display end 
time of the first reproducing section by referring to the 
EP_map of the Clip that the first reproducing section re- 
fers to, and sets a source packet immediately preceding 
the source packet number as a data reading end point 
of the angle from which to make the angle change. 
[0198] In step S148, the control unit 23 obtains a 
source packet number corresponding to the display start 
time of the second reproducing section by referring to 
the EP_map of the Clip that the second reproducing sec- 
tion refers to, and sets a source packet of the source 
packet number as a data reading start point of the angle 
to which to make the angle change. 
[0199] In step S149, the control unit 23 determines 
whether the present reproducing position is the end 
point calculated in the processing of step S147. When 
the present reproducing position is not the end point, the 
control unit 23 stands by until the present reproducing 
position reaches the end point. When the present repro- 
ducing position reaches the end point, the processing 
proceeds to step S150, where the control unit 23 jumps 
the reproducing position to the start point calculated in 
the processing of step S1 48. Thereafter the processing 
returns to step S143 to repeat the processing from step 
S143 on down. 

[0200] The series of processes described above can 
be carried out not only by hardware but also by software. 
In this case, the recording and reproducing apparatus 1 
is formed by a personal computer as shown in FIG. 26, 
for example. 

[0201] A CPU 131 in FIG. 26 performs various 
processing according to a program stored in a ROM 1 32 
or a program loaded from a storage unit 1 38 into a RAM 
133. The RAM 133 also stores data and the like neces- 
sary for the CPU 131 to perform various processing, as 
required. 

[0202] The CPU 1 31 , the ROM 1 32, and the RAM 1 33 
are interconnected via a bus 134. The bus 134 is also 
connected with an input-output interface 135. 
[0203] The input-output interface 135 is connected 
with an input unit 136 including a keyboard, a mouse 
and the like, an output unit 137 including a display 
formed by a CRT (Cathode-Ray Tube), an LCD (Liquid 
Crystal Display) or the like as well as a speaker, a stor- 
age unit 1 38 including a hard disk or the like, and a com- 
municating unit 139 including a modem, a terminal 
adapter or the like. The communicating unit 139 per- 
forms communication processing via a network includ- 
ing the Internet (not shown). 

[0204] When necessary, the input-output interface 
1 35 is also connected with a drive 1 40, into which a mag- 
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netic disk 151, an optical disk 152, a magneto-optical 
disk 1 53, a semiconductor memory 1 54 or the like is in- 
serted as required. A computer program read from the 
magnetic disk 151, the optical disk 152, the magneto- 
optical disk 153, the semiconductor memory 154 or the 
like is installed in the storage unit 138 as required. 
[0205] As shown in FIG. 26, a program storing medi- 
um for storing the program installed in the computer and 
set in a state of being executable by the computer is 
formed by a packaged medium including the magnetic 
disk 151 (including flexible disks), the optical disk 152 
(including CD-ROM (Compact Disk-Read Only Memo- 
ry) and DVD (Digital Versatile Disk)), the magneto-opti- 
cal disk 153 (including MD (Mini-Disk)), the semicon- 
ductor memory 1 54 or the like, or is formed by the ROM 
1 32, the hard disk including the storage unit 1 38, or the 
like, which stores the program temporarily or perma- 
nently. The program is stored on the program storing 
medium using a wireless or wire communication medi- 
um such as a local area network, the Internet, digital 
satellite broadcasting or the like via an interface such as 
a router, a modem or the like, as required. 
[0206] It is to be noted that in the present specifica- 
tion, the steps describing the program stored on the pro- 
gram storing medium include not only processing car- 
ried out in time series in the described order but also 
processing carried out in parallel or individually and not 
necessarily in time series. The present invention is ap- 
plicable to cases where AV streams are recorded or re- 
produced on recording media such as Blu-ray Discs, 
CD-Rs, and other optical disks as well as DVDs, MDs 
and other magneto-optical disks, magnetic disks and 
the like. 

[0207] In addition, while the present invention is ap- 
plied to angle change in multiangle recording and repro- 
duction in the embodiment of the present invention, the 
present invention is applicable to reproduction paths for 
a multistory or rating control, for example. 
[0208] When the recording medium 1 00 for recording 
or reproducing AV streams in FIG. 2 is a disk type re- 
cording medium such as a CD-R or another optical disk 
as well as a DVD, an MD or another magneto-optical 
disk, or a magnetic disk, for example, information is re- 
corded thereon by forming pits or marks on the basis of 
recording waveforms of data on a "track" set concentri- 
cally or spirally on a surface of the disk. 
[0209] On a medium that is pressed to record data, 
such as a CD-ROM, a DVD-ROM and the like, for ex- 
ample, pits, or physical depressions are actually formed 
on the surface. On the other hand, in the case of a write- 
once or rewritable medium such as a CD-R, a CD-RW, 
a DVD-R, a DVD-RW, a DVD-RAM or the like, for ex- 
ample, marks, which are a substitute for the physical de- 
pressions, are formed by applying laser light and there- 
by making the heat produce chemical change in a phase 
change film within the medium, instead of forming the 
depressions. 

[0210] When recorded data is reproduced, laser light 



irradiated from a head to read the data is reflected on 
the surface of the medium. At this time, presence or ab- 
sence of the pits or marks causes change in the reflect- 
ed light, whereby the data is reproduced. 
5 [0211] Methods of recognizing the recorded data in- 
cludes a mark position recording method in which pres- 
ence and absence of pits represent bit data and a mark 
edge recording method in which presence of a pit inverts 
the bit. 

10 [0212] The latter method recognizes a pit read at a 
constant reflectance as "0," and a pit in which the re- 
flectance is changed as "1 ." The method contributes to 
reducing pit length and track loss in recording data. 
[0213] Incidentally, a method of recording or repro- 

15 ducing information on the disk type recording medium 
such as the magnetic disk 151, the optical disk 152, the 
magneto-optical disk 1 53, the ROM 1 32, or the hard disk 
including the storage unit 138 described with reference 
to FIG. 26 is the same as in the case where the recording 

20 medium 100 in FIG. 2 is a disk type recording medium. 

Industrial Applicability 

[0214] According to the present invention, AV signals 
25 can be recorded and reproduced. In addition, informa- 
tion on addresses where data of each reproduction path 
is stored can be obtained quickly. It thereby becomes 
easier to read in advance information on addresses 
where data of each reproduction path to be reproduced 
30 is stored. 



Claims 

35 1 . An information processing apparatus for recording 
AV streams onto a recording medium comprising: 

encoding means for generating each of said AV 
streams forming a plurality of reproduction 

40 paths; 

managing information generating means for 
generating managing information including 
map information indicating positions of entry 
points of each of said AV streams and repro- 

45 duction managing information indicating repro- 

duction path change points set on the basis of 
said entry points included in said map informa- 
tion; and 

recording means for recording said AV streams 
50 and said managing information onto said re- 

cording medium. 

2. An information processing apparatus as claimed in 
claim 1 , wherein said managing information gener- 
55 ating means generates a correspondence table de- 
scribing correspondences between packet num- 
bers and presentation time stamps of said entry 
points as said map information. 
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An information processing apparatus as claimed in 
claim 2, wherein: 

said encoding means generates the AV 
streams one for each of said reproduction 5 
paths; and 

said managing information generating means 
generates said map information and said repro- 
duction managing information regarding all the 
AV streams generated one for each of said re- 10 
production paths as one correspondence table. 



on said recording medium, said recording means 
records said AV streams after interleaving said AV 
streams such that said sections of the reproduction 
paths are in predetermined order. 

10. An information processing apparatus as claimed in 
claim 2, wherein, when recording said AV streams 
on said recording medium, said recording means 
records said AV streams such that a plurality of said 
sections of an identical reproduction path are con- 
tinuous with each other. 



An information processing apparatus as claimed in 
claim 2, wherein said managing information gener- 
ating means generates said map information and 15 
said reproduction managing information regarding 
the AV streams generated one for each of said re- 
production paths separately for each of said repro- 
duction paths. 

20 

An information processing apparatus as claimed in 
claim 4, wherein said managing information gener- 
ated by said managing information generating 
means includes information for specifying each of 
the AV streams generated one for each of the re- 25 
production paths and information for specifying a 
section when? a plurality of said reproduction paths 
are present. 

An information processing apparatus as claimed in 30 
claim 2, wherein: 

said encoding means performs encoding such 
that a viceo stream of each section starting at 
said reproduction path change point is a Closed 35 
GOP starting with an l-picture and a first packet 
is a video packet; and 

said AV streams generated by said encoding 
means are included in a transport stream. 

40 

An information processing apparatus as claimed in 
claim 6, wherein said encoding means sets an iden- 
tical value as. a video packet ID of the transport 
stream and an identical value as an audio packet 
ID of the transport stream in all the reproduction 45 
paths. 

An information processing apparatus as claimed in 
claim 4, furl her comprising source-packetizing 
means for sol rce-packetizing said transport stream 50 
of each section, 

wherein said recording means records said 
transport stream of each section source-packetized 
by said source-packetizing means as an AV stream 
file onto said recording medium. 55 

An information processing apparatus as claimed in 
claim 2, wherein, when recording said AV streams 



11. An information processing apparatus as claimed in 
claim 2, wherein said reproduction managing infor- 
mation includes change information indicating 
whether or not reproduction paths can be changed 
at said entry points. 

12. An information processing method of an information 
processing apparatus for recording AV streams on- 
to a recording medium, said information processing 
method comprising: 

an encoding step of generating each of said AV 
streams forming a plurality of reproduction 
paths; 

a managing information generating step of gen- 
erating managing information including map in- 
formation indicating positions of entry points of 
each of said AV streams and reproduction man- 
aging information indicating reproduction path 
change points set on the basis of said entry 
points included in said map information; and 
a recording step of recording said AV streams 
and said managing information onto said re- 
cording medium. 

13. A program storing medium on which a computer 
readable program for recording AV streams onto a 
recording medium is recorded, said program com- 
prising: 

an encoding step of generating each of said AV 
streams forming a plurality of reproduction 
paths; 

a managing information generating step of gen- 
erating managing information including map in- 
formation indicating positions of entry points of 
each of said AV streams and reproduction man- 
aging information indicating reproduction path 
change points set on the basis of said entry 
points included in said map information; and 
a recording step of recording said AV streams 
and said managing information onto said re- 
cording medium. 

14. A program for recording AV streams onto a record- 
ing medium, said program making a computer per- 
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form: 

an encoding step of generating each of said AV 
streams forming a plurality of reproduction 
paths; 5 
a managing information generating step of gen- 
erating managing information including map in- 
formation indicating positions of entry points of 
each of said AV streams and reproduction man- 
aging information indicating reproduction path 10 
change points set on the basis of said entry 
points included in said map information; and 
a recording step of recording said AV streams 
and said managing information onto said re- 
cording medium. 15 

15. An information processing apparatus for reproduc- 
ing AV streams from a recording medium on which 
said AV streams, map information for managing an 
entity of said AV streams, and reproduction manag- 20 
ing information for managing reproduction of said 
AV streams are recordable, said information 
processing apparatus comprising: 

reading means for reading said reproduction 25 
managing information given to each reproduc- 
tion path having each section divided by a re- 
production path change point of said AV stream 
as a unit, and reading said map information in- 
cluding a correspondence table describing a 30 
correspondence between a packet number and 
a presentation time stamp of said change point 
of said AV stream; 

reproducing means for reproducing said AV 
streams recorded on said recording medium on 35 
the basis of said reproduction managing infor- 
mation read by said reading means; 
retrieving means for, when an instruction to 
make a reproduction path change is given, re- 
trieving said reproduction managing informa- *o 
tion of a reproduction path from which to make 
the reproduction path change and said repro- 
duction managing information of a reproduction 
path to which to make the reproduction path 
change; 45 
first obtaining means for obtaining a reproduc- 
tion end position of said AV stream of the repro- 
duction path from which to make the reproduc- 
tion path change on the basis of said reproduc- 
tion managing information of the reproduction 50 
path from which to make the reproduction path 
change and said correspondence table of the 
reproduction path from which to make the re- 
production path change; 

second obtaining means for obtaining a repro- 55 
duction start position of said AV stream of the 
reproduction path to which to make the repro- 
duction path change on the basis of said repro- 



duction managing information of the reproduc- 
tion path to which to make the reproduction 
path change and said correspondence table of 
the reproduction path to which to make the re- 
production path change; and 
control means for controlling said reproducing 
means to move a reproducing point at said re- 
production end position to said reproduction 
start position. 

An information processing method of an information 
processing apparatus for reproducing AV streams 
from a recording medium on which said AV streams, 
map information for managing an entity of said AV 
streams, and reproduction managing information 
for managing reproduction of said AV streams are 
recordable, said information processing method 
comprising: 

a reading step of reading said reproduction 
managing information given to each reproduc- 
tion path having each section divided by a re- 
production path change point of said AV stream 
as a unit, and reading said map information in- 
cluding a correspondence table describing a 
correspondence between a packet number and 
a presentation time stamp of said change point 
of said AV stream; 

a reproducing step of reproducing said AV 
streams recorded on said recording medium on 
the basis of said reproduction managing infor- 
mation read by processing of said reading step; 
a retrieving step of, when an instruction to make 
a reproduction path change is given, retrieving 
said reproduction managing information of a re- 
production path from which to make the repro- 
duction path change and said reproduction 
managing information of a reproduction path to 
which to make the reproduction path change; 
a first obtaining step of obtaining a reproduction 
end position of said AV stream of the reproduc- 
tion path from which to make the reproduction 
path change on the basis of said reproduction 
managing information of the reproduction path 
from which to make the reproduction path 
change and said correspondence table of the 
reproduction path from which to make the re- 
production path change; 
a second obtaining step of obtaining a repro- 
duction start position of said AV stream of the 
reproduction path to which to make the repro- 
duction path change on the basis of said repro- 
duction managing information of the reproduc- 
tion path to which to make the reproduction 
path change and said correspondence table of 
the reproduction path to which to make the re- 
production path change; and 
a control step of controlling processing of said 
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reproducing step to move a reproducing point 
at said reproduction end position to said repro- 
duction start position. 

17. A program storing medium on which a computer 
readable program is recorded, said program repro- 
ducing AV streams from a recording medium on 
which said AV streams, map information for man- 
aging an entity of said AV streams, and reproduction 
managing information for managing reproduction of 
said AV streams are recordable, said program com- 
prising: 

a reading step of reading said reproduction 
managing information given to each reproduc- 
tion path having each section divided by a re- 
production path change point of said AV stream 
as a unit, and reading said map information in- 
cluding a correspondence table describing a 
correspondence between a packet number and 
a presentation time stamp of said change point 
of said AV stream; 

a reproducing step of reproducing said AV 
streams recorded on said recording medium on 
the bas s of said reproduction managing infor- 
mation read by processing of said reading step; 
a retriev ing step of, when an instruction to make 
a reproduction path change is given, retrieving 
said reproduction managing information of a re- 
production path from which to make the repro- 
duction path change and said reproduction 
managing information of a reproduction path to 
which to make the reproduction path change; 
a first obtaining step of obtaining a reproduction 
end position of said AV stream of the reproduc- 
tion path from which to make the reproduction 
path change on the basis of said reproduction 
managing information of the reproduction path 
from which to make the reproduction path 
change and said correspondence table of the 
reproduction path from which to make the re- 
production path change; 
a second obtaining step of obtaining a repro- 
duction start position of said AV stream of the 
reproduction path to which to make the repro- 
duction path change on the basis of said repro- 
duction managing information of the reproduc- 
tion path to which to make the reproduction 
path change and said correspondence table of 
the reproduction path to which to make the re- 
production path change; and 
a control step of controlling processing of said 
reproducing step to move a reproducing point 
at said reproduction end position to said repro- 
duction start position. 

18. A program for reproducing AV streams from a re- 
cording medium on which said AV streams, map in- 



formation for managing an entity of said AV 
streams, and reproduction managing information 
for managing reproduction of said AV streams are 
recordable, said program making a computer per- 
5 form: 

a reading step of reading said reproduction 
managing information given to each reproduc- 
tion path having each section divided by a re- 
10 production path change point of said AV stream 

as a unit, and reading said map information in- 
cluding a correspondence table describing a 
correspondence between a packet number and 
a presentation time stamp of said change point 
15 of said AV stream; 

a reproducing step of reproducing said AV 
streams recorded on said recording medium on 
the basis of said reproduction managing infor- 
mation read by processing of said reading step; 
20 a retrieving step of, when an instruction to make 

a reproduction path change is given, retrieving 
said reproduction managing information of a re- 
production path from which to make the repro- 
duction path change and said reproduction 
25 managing information of a reproduction path to 

which to make the reproduction path change; 
a first obtaining step of obtaining a reproduction 
end position of said AV stream of the reproduc- 
tion path from which to make the reproduction 
30 path change on the basis of said reproduction 

managing information of the reproduction path 
from which to make the reproduction path 
change and said correspondence table of the 
reproduction path from which to make the re- 
35 production path change; 

a second obtaining step of obtaining a repro- 
duction start position of said AV stream of the 
reproduction path to which to make the repro- 
duction path change on the basis of said repro- 
40 duction managing information of the reproduc- 

tion path to which to make the reproduction 
path change and said correspondence table of 
the reproduction path to which to make the re- 
production path change; and 
45 a control step of controlling processing of said 

reproducing step to move a reproducing point 
at said reproduction end position to said repro- 
duction start position. 

50 19. An information processing apparatus for recording 
AV streams onto a recording medium comprising: 

encoding means for generating each of said AV 
streams forming a plurality of reproduction 
55 paths; 

managing information generating means for 
generating managing information including 
map information indicating a start point of said 
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AV stream of each reproduction path and posi- 
tions of entry points of said AV stream, and re- 
production managing information including the 
start point and an end point of said AV stream, 
reproduction path change points included in 
said entry points included in said map informa- 
tion, and specifying information for specifying 
the AV stream of each reproduction path; and 
recording means for recording said AV streams 
and said managing information onto said re- 
cording medium. 

20. An information processing apparatus as claimed in 
claim 19, wherein said managing information gen- 
erating means generates a correspondence table 
describing correspondences between packet num- 
bers and presentation time stamps of said entry 
points as said map information. 

21. An information processing apparatus as claimed in 
claim 20, wherein: 

said encoding means generates the AV 
streams one for each of said reproduction 
paths; and 

said managing information generating means 
generates said map information and said repro- 
duction managing information regarding all the 
AV streams generated one for each of said re- 
production paths as one correspondence table. 

22. An information processing apparatus as claimed in 
claim 20, wherein said managing information gen- 
erating means generates said map information and 
said reproduction managing information regarding 
the AV streams generated one for each of said re- 
production paths separately for each of said repro- 
duction paths. 

23. An information processing apparatus as claimed in 
claim 22, wherein said managing information gen- 
erated by said managing information generating 
means includes information for specifying each of 
the AV streams generated one for each of the re- 
production paths and information for specifying a 
section where a plurality of said reproduction paths 
are present. 

24. An information processing apparatus as claimed in 
claim 20, wherein: 

said encoding means performs encoding such 
that a video stream of each section starting at 
said reproduction path change point is a Closed 
GOP starting with an I-picture and a first packet 
is a video packet; and 

said AV streams generated by said encoding 
means are included in a transport stream. 



25. An information processing apparatus as claimed in 
claim 24, wherein said encoding means performs 
encoding such that a start of the video stream of 
each section is said Closed GOP and a subsequent 

5 part of the video stream of each section is a 
non-Closed GOP. 

26. An information processing apparatus as claimed in 
claim 22, further comprising source-packetizing 

10 means for source-packetizing said transport stream 
of each section, 

wherein said recording means records said 
transport stream of each section source-packetized 
by said source-packetizing means as an AV stream 
15 file onto said recording medium. 

27. An information processing apparatus as claimed in 
claim 26, wherein said managing information gen- 
erating means generates one said correspondence 

20 table to be included in said map information, said 
correspondence table corresponding to said AV 
stream file. 

28. An information processing apparatus as claimed in 
25 claim 20, wherein, when recording said AV streams 

on said recording medium, said recording means 
records said AV streams after interleaving said AV 
streams such that said sections of the reproduction 
paths are in predetermined order. 

30 

29. An information processing apparatus as claimed in 
claim 20, wherein, when recording said AV streams 
on said recording medium, said recording means 
records said AV streams such that a plurality of said 

35 sections of an identical reproduction path are con- 
tinuous with each other. 

30. An information processing apparatus as claimed in 
claim 19, wherein said reproduction managing in- 

40 formation includes change information indicating 
whether or not reproduction paths can be changed 
at said entry points. 

31 . An information processing method of an information 
45 processing apparatus for recording AV streams on- 
to a recording medium, said information processing 
method comprising: 

an encoding step of generating each of said AV 
so streams forming a plurality of reproduction 

paths; 

a managing information generating step of gen- 
erating managing information including map in- 
formation indicating a start point of said AV 
55 stream of each reproduction path and positions 

of entry points of said AV stream, and reproduc- 
tion managing information including the start 
point and an end point of said AV stream, re- 
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production path change points included in said 
entry po nts included in said map information, 
and specifying information for specifying the AV 
stream of each reproduction path; and 
a recording step of recording said AV streams 5 
and said managing information onto said re- 
cording medium. 

32. A program storing medium on which a computer 
readable program of an information processing ap- 10 
paratus for recording AV streams onto a recording 
medium is recorded, said program comprising: 

an encoding step of generating each of said AV 
streams forming a plurality of reproduction 15 
paths; 

a managing information generating step of gen- 
erating managing information including map in- 
formation indicating a start point of said AV 
stream of each reproduction path and positions 20 
of entry points of said AV stream, and reproduc- 
tion managing information including the start 
point and an end point of said AV stream, re- 
production path change points included in said 
entry points included in said map information, 25 
and specifying information for specifying the AV 
stream of each reproduction path; and 
a recording step of recording said AV streams 
and said managing information onto said re- 
cording medium. 30 

33. A program of an information processing apparatus 
for recording AV streams onto a recording medium, 
said program making a computer perform: 

35 

an encoding step of generating each of said AV 
streams forming a plurality of reproduction 
paths; 

a managing information generating step of gen- 
erating managing information including map in- 40 
formation indicating a start point of said AV 
stream of each reproduction path and positions 
of entry points of said AV stream, and reproduc- 
tion managing information including the start 
point and an end point of said AV stream, re- 45 
production path change points included in said 
entry points included in said map information, 
and specifying information for specifying the AV 
stream of each reproduction path; and 
a recording step of recording said AV streams 50 
and said managing information onto said re- 
cording medium. 

34. An information processing apparatus for reproduc- 
ing AV streams from a recording medium on which 55 
said AV streams, map information for managing an 
entity of said AV streams, and reproduction manag- 
ing information for managing reproduction of said 



AV streams are recordable, said information 
processing apparatus comprising: 

reading means for reading said reproduction 
managing information including a reproduction 
path change point of said AV streams, a start 
point and an end point of said AV streams, and 
specifying information for specifying the AV 
stream of each reproduction path, and reading 
said map information including a correspond- 
ence table describing correspondences be- 
tween packet numbers and presentation time 
stamps of said start point and said change point 
of said AV streams; 

reproducing means for reproducing said AV 
streams recorded on said recording medium on 
the basis of said reproduction managing infor- 
mation read by said reading means; 
retrieving means for, when an instruction to 
make a reproduction path change is given, re- 
trieving said section of a reproduction path from 
which to make the reproduction path change 
and said section of a reproduction path to which 
to make the reproduction path change; 
first obtaining means for obtaining a reproduc- 
tion end position of said AV stream of the repro- 
duction path from which to make the reproduc- 
tion path change on the basis of said section of 
the reproduction path from which to make the 
reproduction path change and said corre- 
spondence table of the reproduction path from 
which to make the reproduction path change; 
second obtaining means for obtaining a repro- 
duction start position of said AV stream of the 
reproduction path to which to make the repro- 
duction path change on the basis of said sec- 
tion of the reproduction path to which to make 
the reproduction path change and said corre- 
spondence table of the reproduction path to 
which to make the reproduction path change; 
and 

control means for controlling said reproducing 
means to move a reproducing point at said re- 
production end position to said reproduction 
start position. 

35. An information processing method of an information 
processing apparatus for reproducing AV streams 
from a recording medium on which said AV streams, 
map information for managing an entity of said AV 
streams, and reproduction managing information 
for managing reproduction of said AV streams are 
recordable, said information processing method 
comprising: 

a reading step of reading said reproduction 
managing information including a reproduction 
path change point of said AV streams, a start 
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point and an end point of said AV streams, and 
specifying information for specifying the AV 
stream of each reproduction path, and reading 
said map information including a correspond- 
ence table describing correspondences be- 5 
tween packet numbers and presentation time 
stamps of said start point and said change point 
of said AV streams; 

a reproducing step of reproducing said AV 
streams recorded on said recording medium on 10 
the basis of said reproduction managing infor- 
mation read by processing of said reading step; 
a retrieving step of, when an instruction to make 
a reproduction path change is given, retrieving 
said section of a reproduction path from which 15 
to make the reproduction path change and said 
section of a reproduction path to which to make 
the reproduction path change; 
a first obtaining step of obtaining a reproduction 
end position of said AV stream of the reproduc- 20 
tion path from which to make the reproduction 
path change on the basis of said section of the 
reproduction path from which to make the re- 
production path change and said correspond- 
ence table of the reproduction path from which 25 
to make the reproduction path change; 
a second obtaining step of obtaining a repro- 
duction start position of said AV stream of the 
reproduction path to which to make the repro- 
duction path change on the basis of said sec- 30 
tion of the reproduction path to which to make 
the reproduction path change and said corre- 
spondence table of the reproduction path to 
which to make the reproduction path change; 
and 35 
a control step of controlling processing of said 
reproducing step to move a reproducing point 
at said reproduction end position to said repro- 
duction start position. 

40 

36. A program storing medium on which a computer 
readable program is recorded, said program repro- 
ducing AV streams from a recording medium on 
which said AV streams, map information for man- 
aging an entity of said AV streams, and reproduction 45 
managing information for managing reproduction of 
said AV streams are recordable, said program com- 
prising: 

a reading step of reading said reproduction 50 
managing information including a reproduction 
path change point of said AV streams, a start 
point and an end point of said AV streams, and 
specifying information for specifying the AV 
stream of each reproduction path, and reading 55 
said map information including a correspond- 
ence table describing correspondences be- 
tween packet numbers and presentation time 



stamps of said start point and said change point 
of said AV streams; 

a reproducing step of reproducing said AV 
streams recorded on said recording medium on 
the basis of said reproduction managing infor- 
mation read by processing of said reading step; 
a retrieving step of, when an instruction to make 
a reproduction path change is given, retrieving 
said section of a reproduction path from which 
to make the reproduction path change and said 
section of a reproduction path to which to make 
the reproduction path change; 
a first obtaining step of obtaining a reproduction 
end position of said AV stream of the reproduc- 
tion path from which to make the reproduction 
path change on the basis of said section of the 
reproduction path from which to make the re- 
production path change and said correspond- 
ence table of the reproduction path from which 
to make the reproduction path change; 
a second obtaining step of obtaining a repro- 
duction start position of said AV stream of the 
reproduction path to which to make the repro- 
duction path change on the basis of said sec- 
tion of the reproduction path to which to make 
the reproduction path change and said corre- 
spondence table of the reproduction path to 
which to make the reproduction path change; 
and 

a control step of controlling processing of said 
reproducing step to move a reproducing point 
at said reproduction end position to said repro- 
duction start position. 

37. A program for reproducing AV streams from a re- 
cording medium on which said AV streams, map in- 
formation for managing an entity of said AV 
streams, and reproduction managing information 
for managing reproduction of said AV streams are 
recordable, said program making a computer per- 
form: 

a reading step of reading said reproduction 
managing information including a reproduction 
path change point of said AV streams, a start 
point and an end point of said AV streams, and 
specifying information for specifying the AV 
stream of each reproduction path, and reading 
said map information including a correspond- 
ence table describing correspondences be- 
tween packet numbers and presentation time 
stamps of said start point and said change point 
of said AV streams; 

a reproducing step of reproducing said AV 
streams recorded on said recording medium on 
the basis of said reproduction managing infor- 
mation read by processing of said reading step; 
a retrieving step of, when an instruction to make 
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a reproduction path change is given, retrieving 
said section of a reproduction path from which 
to make the reproduction path change and said 
section of a reproduction path to which to make 
the reproduction path change; 5 
a first obtaining step of obtaining a reproduction 
end position of said AV stream of the reproduc- 
tion path from which to make the reproduction 
path change on the basis of said section of the 
reproduction path from which to make the re- 10 
production path change and said correspond- 
ence table of the reproduction path from which 
to make the reproduction path change; 
a second obtaining step of obtaining a repro- 
duction start position of said AV stream of the 15 
reproduction path to which to make the repro- 
duction path change on the basis of said sec- 
tion of the reproduction path to which to make 
the reproduction path change and said corre- 
spondence table of the reproduction path to 20 
which to make the reproduction path change; 
and 

a control step of controlling processing of said 
reproducing step to move a reproducing point 
at said reproduction end position to said repro- 25 
duction start position. 

38. A computer readable recording medium on which 
AV streams, map information for managing an entity 

of said AV streams, and reproduction managing in- 30 
formation for managing reproduction of said AV 
streams are recordable, 

wherein data is recorded having a structure 
such that: 

35 

said reproduction managing information in- 
cludes information on a reproduction path 
change point of said AV streams and a start 
point and an end point of said AV streams; and 
said map information includes a correspond- 40 
ence table describing correspondences be- 
tween packet numbers and presentation time 
stamps of said start point and said change point 
of said AV streams. 

45 

39. A computer readable recording medium on which 
AV streams, map information for managing an entity 
of said AV streams, and reproduction managing in- 
formation for managing reproduction of said AV 
streams are recordable, 50 

wherein data is recorded having a structure 
such that: 

said reproduction managing information in- 
cludes a reproduction path change point of said 55 
AV streams, a start point and an end point of 
said AV streams, and specifying information for 
specifying the AV stream of each reproduction 



path; and 

said map information includes a correspond- 
ence table describing correspondences be- 
tween packet numbers and presentation time 
stamps of said start point and said change point 
of said AV streams. 
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FIG. 1 

1-1: CELL #m 

1-2: CELL #i 

1-3: CELL #i + 1 

1-4: CELL #i + 2 

1-5: CELL #i + 3 

1-6: ANGLE #1 

1-7: ANGLE #2 

1-8: ANGLE #3 

1-9: CELL #i + 4 
1-10: CELL #m + n 

FIG. 2 

1: RECORDING AND REPRODUCING APPARATUS 

2: RECORDING UNIT 

3: REPRODUCING UNIT 

14: ANALYZING UNIT 

15: AV ENCODER 

16: MULTIPLEXER 

18: MULTIPLEXED STREAM ANALYZING UNIT 
19: SOURCE PACKETIZER 
20: ECC CODING UNIT 
21: MODULATING UNIT 
22: WRITING UNIT 
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23: CONTROL UNIT 

26: DEMULTIPLEXER 

27: AV DECODER 

28: READING UNIT 

29: DEMODULATING UNIT 

30: ECC DECODING UNIT 

31: SOURCE DEPACKETIZER 

100: RECORDING MEDIUM 

FIG. 3 

3-1: PlayList layer 

3-2: Clip layer 

3- 3: Address 

FIG. 4 

4- 1: ALIGNED UNIT 
4-2: ALIGNED UNIT 
4-3: ALIGNED UNIT 
4-4: ALIGNED UNIT 
4-5: ALIGNED UNIT 
4-6: SOURCE PACKET - 0 
4-7: SOURCE PACKET - 1 
4-8: SOURCE PACKET - 2 
4-9: SOURCE PACKET - 31 



29 



EP 1 566 965 A1 



4- 10: TRANSPORT PACKET 
FIG. 5 

5- 1: ANGLE CHANGE POINT 
FIG. 6 

6- 1: START ANGLE CHANGE PROCESSING 

6- 2: END 

SI: IS INSTRUCTION TO CHANGE ANGLE GIVEN? 
S2: IS INSTRUCTION TO END GIVEN? 
S3: ANGLE CHANGE POINT? 

S4: CHANGE TO PLAY ITEM OF SPECIFIED ANGLE 
FIG. 7 

7- 1: EP_map of Clip Information 1 
7-2: EP_map of Clip Information 2 

7- 3: EP_map of Clip Information 3 

FIG. 8 

8- 1: START DATA READING ADDRESS DETERMINATION PROCESSING 
USING EP_MAP 

8-2: END 

S21: CHANGE REPRODUCTION PATH 

S22: DETERMINE SOURCE PACKET NUMBERS AS Al READING START 
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ADDRESS AND Al READING END ADDRESS 

S23: OBTAIN B2 READING START ADDRESS AND B2 READING END 
ADDRESS 

S24: DETERMINE SOURCE PACKET NUMBERS AS B2 READING START 

ADDRESS AND B2 READING END ADDRESS 

S25: OBTAIN C3 READING START ADDRESS AND C3 READING END 
ADDRESS 

S26: DETERMINE SOURCE PACKET NUMBERS AS C3 READING START 

ADDRESS AND C3 READING END ADDRESS 



FIG. 9 

9-1: DATA ON DISK 



FIG. 10 

10-1: DATA ON DISK 



FIG. 11 

11-1: EP_map of Clip Information 1 
11-2: EP_map of Clip Information 2 
11-3: EP_map of Clip Information 3 



FIG. 12 

12-1: EP_map of Clip Information 1 
12-2: EP_map of Clip Information 2 



31 



EP 1 566 965 A1 



12-3: EP_map of Clip Information 3 
12-4: ANGLE CHANGE POINT 

12- 5: ANGLE CHANGE POINT 

FIG. 13 

13- 1: START AV SIGNAL RECORDING PROCESSING 

13- 2: END 

S41: DIVIDE EACH ANGLE SECTION INTO PREDETERMINED 
SECTIONS 

S42: ENCODE AV SIGNALS OF ANGLES 

S43: MULTIPLEX VIDEO STREAM AND AUDIO STREAM 

S44: INTERLEAVE 

S45: SOURCE- PACKET I ZE TRANSPORT STREAM AND RECORD SOURCE- 

PACKETIZED TRANSPORT STREAM ON RECORDING MEDIUM 

S4 6: OBTAIN TIME STAMPS AND PACKET NUMBERS AND ADD TIME 

STAMPS AND PACKET NUMBERS TO EP_MAP 

S47: RECORD EP_MAP 

S48: GENERATE PLAYLISTS 

S4 9 : RECORD PLAYLIST FILES 

FIG. 14 

14- 1: START REPRODUCTION PROCESSING 
14-2: END 

S61: READ PLAYLIST FILES AND CLIP INFORMATION FILE 
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S62: F.EPRODUCE AV STREAM DATA ON BASIS OF PLAYLIST 
S63: FAS USER GIVEN INSTRUCTION TO CHANGE ANGLE? 
S64: IS INSTRUCTION TO END GIVEN? 
S65: RETRIEVE FIRST PLAY ITEM 
S66: RETRIEVE SECOND PLAY IT EM 

S67: OBTAIN SOURCE PACKET NUMBER AT DISPLAY END TIME OF 
FIRST PLAY ITEM AND SET PACKET IMMEDIATELY PRECEDING THAT 
SOURCE PACKET NUMBER AS DATA READING END POINT OF ANGLE 
FROM WHICH TO MAKE ANGLE CHANGE 

S68: OBTAIN SOURCE PACKET NUMBER AT DISPLAY START TIME OF 
SECOND PLAY IT EM AND SET PACKET OF THAT SOURCE PACKET 
NUMBER AS DATA READING START POINT OF ANGLE TO WHICH TO 
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15-1: IN POINT 
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FIG. 17 

17-1: START REPRODUCTION PROCESSING 1 
17-2: END 
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22-1: START DATA READING ADDRESS DETERMINATION PROCESSING 
USING EP_MAP 
22-2: END 
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ADDRESS 
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23-1: MULT I ANGLE TYPE 



FIG. 25 

25-1: START REPRODUCTION PROCESSING 2 
25-2: END 
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FIG. 2 6 

135: INPUT-OUTPUT INTERFACE 

136: INPUT UNIT 

137: OUTPUT UNIT 

138: STORAGE UNIT 

139: COMMUNICATING UNIT 

140: drive 
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for ( i =0 ; i <nunL_of _P I ay I terns ; i ++) { 
Playltem () 
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PlayltemO { 

if (Mult i Angle type) { 
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} else { 
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0UT_time 
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